Jun 24 04:05:48 devstack cinder-volume[82439]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 24 04:05:48 devstack cinder-volume[82439]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:05:48 devstack cinder-volume[82439]: we strongly recommend against using it for new projects.
Jun 24 04:05:48 devstack cinder-volume[82439]: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:05:48 devstack cinder-volume[82439]: framework.  For more detail see
Jun 24 04:05:48 devstack cinder-volume[82439]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:05:48 devstack cinder-volume[82439]:   import eventlet  # noqa
Jun 24 04:05:51 devstack cinder-volume[82439]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82439) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:05:51 devstack cinder-volume[82439]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82439) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:05:51 devstack cinder-volume[82439]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82439) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:05:51 devstack cinder-volume[82439]: INFO dbcounter [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Registered counter for database cinder
Jun 24 04:05:52 devstack cinder-volume[82439]: DEBUG oslo_db.sqlalchemy.engines [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:05:52 devstack cinder-volume[82439]: DEBUG dbcounter [-] [82439] Writer thread running {{(pid=82439) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:05:52 devstack cinder-volume[82439]: INFO cinder.rpc [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 24 04:05:52 devstack cinder-volume[82439]: INFO cinder.rpc [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 24 04:05:52 devstack cinder-volume[82439]: DEBUG oslo_db.sqlalchemy.engines [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:05:52 devstack cinder-volume[82439]: INFO cinder.volume.manager [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Determined volume DB was empty at startup.
Jun 24 04:05:52 devstack cinder-volume[82439]: DEBUG cinder.volume.manager [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82439) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 24 04:05:52 devstack cinder-volume[82439]: INFO cinder.volume.manager [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 24 04:05:52 devstack cinder-volume[82439]: WARNING stevedore.named [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 24 04:05:52 devstack cinder-volume[82439]: WARNING castellan.key_manager [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:05:52 devstack cinder-volume[82439]: WARNING cinder.keymgr.conf_key_mgr [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:05:52 devstack cinder-volume[82439]: DEBUG cinder.volume.drivers.lvm [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82439) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jun 24 04:05:52 devstack cinder-volume[82439]: DEBUG oslo_concurrency.processutils [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82439) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_concurrency.processutils [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] CMD "cinder-rtstool verify" returned: 0 in 0.602s {{(pid=82439) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_db.sqlalchemy.engines [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:05:53 devstack cinder-volume[82439]: INFO cinder.rpc [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jun 24 04:05:53 devstack cinder-volume[82439]: INFO cinder.rpc [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jun 24 04:05:53 devstack cinder-volume[82439]: WARNING stevedore.named [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 24 04:05:53 devstack cinder-volume[82439]: WARNING castellan.key_manager [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:05:53 devstack cinder-volume[82439]: INFO cinder.volume.manager [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_db.sqlalchemy.engines [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82439) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:05:53 devstack cinder-volume[82439]: INFO oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Starting 1 workers
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Started child 82604 {{(pid=82439) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Full set of CONF: {{(pid=82439) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] ******************************************************************************** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Configuration options gathered from: {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] ================================================================================ {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] allow_availability_zone_fallback = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] allow_compression_on_image_upload = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] allowed_direct_url_schemes     = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] api_rate_limit                 = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] auth_strategy                  = keystone {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] az_cache_duration              = 3600 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_availability_zone      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_host                   = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_name                   = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82604]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_stats_polling_interval = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backup_api_class               = cinder.backup.api.API {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backup_name_template           = backup-%s {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backup_use_same_host           = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backup_use_temp_snapshot       = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] chap_password                  = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] chap_username                  =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_internal_tenant_project_id = fffc6d19eedd4c16a84de413d08c6f7f {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_internal_tenant_user_id = 3564b180cf0f4af5a90fc4e80efa264f {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cloned_volume_same_az          = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cluster                        = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] compression_format             = gzip {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] compute_api_class              = cinder.compute.nova.API {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] config_dir                     = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] config_source                  = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] control_exchange               = openstack {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] debug                          = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] default_availability_zone      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] default_group_type             = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] default_volume_type            = lvmdriver-1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] disk_geometry                  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] driver_client_cert             = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] driver_client_cert_key         = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] driver_data_namespace          = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] driver_ssl_cert_path           = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] driver_ssl_cert_verify         = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] driver_use_ssl                 = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] enable_force_upload            = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] enable_new_services            = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] enable_unsupported_driver      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] enforce_multipath_for_image_xfer = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] filter_function                = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_api_insecure            = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_api_servers             = ['http://192.168.122.16/image'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_api_ssl_compression     = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_ca_certificates_file    = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_catalog_info            = image:glance:publicURL {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_certfile                = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_keyfile                 = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_num_retries             = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance_request_timeout         = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] goodness_function              = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] graceful_shutdown_timeout      = 5 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] group_api_class                = cinder.group.api.API {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] host                           = devstack {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_compress_on_upload       = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_conversion_address_space_limit = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_conversion_cpu_limit     = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_conversion_disable       = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_upload_use_cinder_backend = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_upload_use_internal_tenant = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_volume_cache_enabled     = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_volume_cache_max_count   = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] image_volume_cache_max_size_gb = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] init_host_max_objects_retrieval = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] instance_format                = [instance: %(uuid)s]  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] iscsi_target_flags             =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] iscsi_write_cache              = on {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] iser_helper                    = tgtadm {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] iser_ip_address                = 192.168.122.16 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] iser_port                      = 3260 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_color                      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_config_append              = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_dir                        = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_file                       = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_options                    = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_rotate_interval            = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_rotate_interval_type       = days {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] log_rotation_type              = none {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] max_age                        = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] max_logfile_count              = 30 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] max_logfile_size_mb            = 200 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] max_over_subscription_ratio    = 20.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] message_reap_interval          = 86400 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] message_ttl                    = 2592000 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] migration_create_volume_timeout_secs = 300 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] monkey_patch                   = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] monkey_patch_modules           = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] my_ip                          = 192.168.122.16 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] no_snapshot_gb_quota           = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] num_iser_scan_tries            = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] num_shell_tries                = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] num_volume_device_scan_tries   = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] nvmeof_conn_info_version       = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] nvmet_ns_id                    = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] nvmet_port_id                  = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] osapi_max_limit                = 1000 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] osapi_volume_ext_list          = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] osapi_volume_listen_port       = 8776 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] osapi_volume_use_ssl           = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] osapi_volume_workers           = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] per_volume_size_limit          = -1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] periodic_fuzzy_delay           = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] periodic_interval              = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] public_endpoint                = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] publish_errors                 = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] quota_backup_gigabytes         = 1000 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] quota_backups                  = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] quota_gigabytes                = 1000 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] quota_groups                   = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] quota_snapshots                = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] quota_volumes                  = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] rate_limit_burst               = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] rate_limit_except_level        = CRITICAL {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] rate_limit_interval            = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] reinit_driver_count            = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] replication_device             = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] report_discard_supported       = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] report_interval                = 120 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] reservation_clean_interval     = 86400 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] reservation_expire             = 86400 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] reserved_image_namespaces      = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] reserved_percentage            = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] rpc_response_timeout           = 120 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] run_external_periodic_tasks    = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] scst_target_driver             = iscsi {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] scst_target_iqn_name           = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_down_time              = 720 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] shell_completion               = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] snapshot_name_template         = snapshot-%s {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] snapshot_same_host             = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] split_loggers                  = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] state_path                     = /opt/stack/data/cinder {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] storage_availability_zone      = nova {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] storage_protocol               = iSCSI {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] syslog_log_facility            = LOG_USER {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] target_helper                  = lioadm {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] target_ip_address              = 192.168.122.16 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] target_port                    = 3260 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] target_protocol                = iscsi {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] target_secondary_ip_addresses  = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] trace_flags                    = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] transport_url                  = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] until_refresh                  = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] use_chap_auth                  = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] use_default_quota_class        = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] use_journal                    = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] use_json                       = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] use_multipath_for_image_xfer   = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] use_stderr                     = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] use_syslog                     = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] verify_glance_signatures       = enabled {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_api_class               = cinder.volume.api.API {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_backend_name            = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_clear                   = zero {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_clear_ionice            = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_clear_size              = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_copy_bps_limit          = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_dd_blocksize            = 1M {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_name_template           = volume-%s {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_service_inithost_offload = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volume_usage_audit_period      = month {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] zoning_mode                    = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_concurrency.disable_process_locking = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.auth_section = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.auth_type   = password {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.auth_version = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.cache       = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.certfile    = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.delay_auth_decision = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.http_connect_timeout = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.include_service_catalog = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.insecure    = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.interface   = public {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.keyfile     = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_password =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcache_username =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.region_name = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.service_token_roles_required = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.service_type = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.token_cache_time = 300 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.backend                  = dogpile.cache.null {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.backend_argument         = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.backend_expiration_time  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.config_prefix            = cache.oslo {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.debug_cache_backend      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.enable_retry_client      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.enable_socket_keepalive  = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.enabled                  = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.expiration_time          = 600 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.hashclient_retry_attempts = 2 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.memcache_dead_retry      = 300 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.memcache_pool_maxsize    = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.memcache_sasl_enabled    = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.password                 = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.proxies                  = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack sudo[82608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.redis_db                 = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.redis_sentinel_service_name = mymaster {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.redis_server             = localhost:6379 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack sudo[82608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.retry_attempts           = 2 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.retry_delay              = 0.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.socket_keepalive_count   = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.socket_keepalive_idle    = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.socket_keepalive_interval = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.socket_timeout           = 1.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.tls_allowed_ciphers      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.tls_cafile               = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.tls_certfile             = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.tls_enabled              = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.tls_keyfile              = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cache.username                 = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] coordination.backend_url       = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.asyncio_connection    = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.asyncio_slave_connection = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.backend               = sqlalchemy {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.connection            = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.connection_debug      = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.connection_parameters =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.connection_recycle_time = 3600 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.connection_trace      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.db_inc_retry_interval = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.db_max_retries        = 20 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.db_max_retry_interval = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.db_retry_interval     = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.max_overflow          = 50 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.max_pool_size         = 5 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.max_retries           = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.mysql_wsrep_sync_wait = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.pool_timeout          = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.retry_interval        = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.slave_connection      = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.sqlite_synchronous    = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.synchronous_reader    = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] database.use_db_reconnect      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.connection_string     = messaging:// {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.enabled               = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.es_doc_type           = notification {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.es_scroll_size        = 10000 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.es_scroll_time        = 2m {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.filter_error_trace    = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.hmac_keys             = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.sentinel_service_name = mymaster {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.socket_timeout        = 0.1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.trace_requests        = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler.trace_sqlalchemy      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler_jaeger.process_tags   = {} {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler_jaeger.service_name_prefix = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] profiler_otlp.service_name_prefix = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.enforce_new_defaults = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: WARNING oslo_config.cfg [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.enforce_scope      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.policy_default_rule = default {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.policy_file        = policy.yaml {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] privsep_osbrick.group          = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] privsep_osbrick.helper_command = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] privsep_osbrick.user           = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_sys_admin.group         = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_sys_admin.helper_command = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] cinder_sys_admin.user          = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.auth_section      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.auth_type         = password {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.cafile            = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.certfile          = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.collect_timing    = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.insecure          = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.keyfile           = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.send_service_user_token = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.split_loggers     = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] service_user.timeout           = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.auth_section            = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.auth_type               = password {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.certfile                = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.collect_timing          = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.insecure                = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.keyfile                 = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.region_name             = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.split_loggers           = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] glance.timeout                 = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.backend_availability_zone = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.chap_password = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.chap_username =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.disk_geometry = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.driver_client_cert = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.driver_client_cert_key = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.driver_data_namespace = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.driver_use_ssl = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.enable_unsupported_driver = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.extra_capabilities = {} {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.filter_function = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.goodness_function = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.iscsi_target_flags =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.iscsi_write_cache = on {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.iser_helper   = tgtadm {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.iser_port     = 3260 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.lvm_share_target = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.lvm_type      = auto {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.num_shell_tries = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.nvmet_port_id = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.replication_device = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.report_discard_supported = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.reserved_percentage = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.scst_target_driver = iscsi {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.scst_target_iqn_name = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.storage_protocol = iSCSI {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.target_helper = tgtadm {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.target_port   = 3260 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.target_protocol = iscsi {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.trace_flags   = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.unique_fqdn_network = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.use_chap_auth = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_backend_name = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_clear  = zero {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_clear_ionice = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_clear_size = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_reports.file_event_handler = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_reports.log_dir           = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.backend_availability_zone = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.backend_host       = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.chap_password      = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.chap_username      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.disk_geometry      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.driver_client_cert = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.driver_data_namespace = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.extra_capabilities = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.filter_function    = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.goodness_function  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.iser_helper        = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.iser_ip_address    = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.iser_port          = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.iser_target_prefix = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.lvm_share_target   = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.lvm_type           = auto {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.num_shell_tries    = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.replication_device = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.report_discard_supported = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.reserved_percentage = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.scst_target_driver = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.storage_protocol   = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.target_helper      = lioadm {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.target_ip_address  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.target_port        = 3260 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.trace_flags        = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.use_chap_auth      = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_clear       = zero {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_clear_size  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] lvmdriver-1.volumes_dir        = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.ssl      = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_notifications.driver = [] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_notifications.retry = -1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] key_manager.fixed_key          = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.barbican_api_version  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.barbican_endpoint     = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.barbican_endpoint_type = public {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.barbican_region_name  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.cafile                = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.certfile              = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.collect_timing        = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.insecure              = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.keyfile               = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.number_of_retries     = 60 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.retry_delay           = 1 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.send_service_user_token = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.split_loggers         = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.timeout               = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.verify_ssl            = True {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican.verify_ssl_path       = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.auth_section = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.auth_type = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.cafile   = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.certfile = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.collect_timing = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.insecure = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.keyfile  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.split_loggers = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] barbican_service_user.timeout  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.approle_role_id          = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.approle_secret_id        = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.kv_mountpoint            = secret {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.kv_path                  = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.kv_version               = 2 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.namespace                = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.root_token_id            = **** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.ssl_ca_crt_file          = None {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.timeout                  = 60.0 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.use_ssl                  = False {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:05:53 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] ******************************************************************************** {{(pid=82439) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 24 04:05:54 devstack sudo[82608]: pam_unix(sudo:session): session closed for user root
Jun 24 04:05:54 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:54 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:54 devstack sudo[82615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:05:54 devstack sudo[82615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:05:54 devstack sudo[82615]: pam_unix(sudo:session): session closed for user root
Jun 24 04:05:54 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.662s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:54 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:05:54 devstack cinder-volume[82604]: INFO cinder.brick.local_dev.lvm [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jun 24 04:05:54 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:54 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:54 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:54 devstack sudo[82859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:05:54 devstack sudo[82859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:05:55 devstack sudo[82859]: pam_unix(sudo:session): session closed for user root
Jun 24 04:05:55 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:55 devstack cinder-volume[82604]: DEBUG cinder.brick.local_dev.lvm [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82604) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jun 24 04:05:55 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:55 devstack sudo[83089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:05:55 devstack sudo[83089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:05:57 devstack sudo[83089]: pam_unix(sudo:session): session closed for user root
Jun 24 04:05:57 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.500s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:57 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:57 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:57 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:57 devstack sudo[83360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:05:57 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:05:57 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root
Jun 24 04:05:57 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.741s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:57 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:57 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:57 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:57 devstack sudo[83390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jun 24 04:05:57 devstack sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:05:58 devstack sudo[83390]: pam_unix(sudo:session): session closed for user root
Jun 24 04:05:58 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.671s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:58 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:58 devstack sudo[83394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:05:58 devstack sudo[83394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:05:59 devstack sudo[83394]: pam_unix(sudo:session): session closed for user root
Jun 24 04:05:59 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.902s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:05:59 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:05:59 devstack sudo[83406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:05:59 devstack sudo[83406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:00 devstack sudo[83406]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:00 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.893s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:00 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:00 devstack sudo[83412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:00 devstack sudo[83412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:01 devstack sudo[83412]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:01 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.778s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:01 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:01 devstack sudo[83420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:01 devstack sudo[83420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:01 devstack sudo[83420]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:01 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:01 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:01 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:01 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:01 devstack sudo[83424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:01 devstack sudo[83424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:02 devstack sudo[83424]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:02 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.799s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:02 devstack cinder-volume[82604]: INFO cinder.volume.drivers.lvm [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jun 24 04:06:02 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:02 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:02 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:02 devstack sudo[83468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:02 devstack sudo[83468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:03 devstack sudo[83468]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:03 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:03 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:06:03 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:03 devstack sudo[83550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:03 devstack sudo[83550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:03 devstack cinder-volume[82439]: DEBUG dbcounter [-] [82439] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82439) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:06:03 devstack sudo[83550]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:03 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:03 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:03 devstack sudo[83692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:03 devstack sudo[83692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:04 devstack sudo[83692]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:04 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:04 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:04 devstack sudo[83695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:04 devstack sudo[83695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:05 devstack sudo[83695]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:05 devstack sudo[83698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:05 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:05 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:05 devstack cinder-volume[82604]: INFO cinder.volume.driver [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Driver hasn't implemented _init_vendor_properties()
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG cinder.volume.driver [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82604) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG oslo_db.sqlalchemy.engines [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writer thread running {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG cinder.db.api [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Building query based on filter {{(pid=82604) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG cinder.image.image_utils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82604) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 24 04:06:05 devstack cinder-volume[82604]: INFO cinder.keymgr.migration [None req-258771cf-65de-4dfa-9b04-c3d6afe5e097 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:06:05 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:05 devstack sudo[83707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:05 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:06 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:06 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:06 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:06 devstack sudo[83710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:06 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:07 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:07 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:07 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:07 devstack sudo[83713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:07 devstack sudo[83713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:07 devstack sudo[83713]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:07 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.670s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:07 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:07 devstack sudo[83717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:07 devstack sudo[83717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:08 devstack sudo[83717]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:08 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:08 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:06:08 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Driver initialization completed successfully.
Jun 24 04:06:08 devstack cinder-volume[82604]: INFO cinder.manager [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Initiating service 2 cleanup
Jun 24 04:06:08 devstack cinder-volume[82604]: INFO cinder.manager [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Service 2 cleanup completed.
Jun 24 04:06:08 devstack cinder-volume[82604]: DEBUG cinder.service [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Creating RPC server for service cinder-volume {{(pid=82604) start /opt/stack/cinder/cinder/service.py:231}}
Jun 24 04:06:08 devstack cinder-volume[82604]: DEBUG cinder.service [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82604) start /opt/stack/cinder/cinder/service.py:237}}
Jun 24 04:06:08 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jun 24 04:06:08 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:06:08 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:08 devstack sudo[83720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:06:08 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:09 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:09 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:09 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:09 devstack sudo[83727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:09 devstack sudo[83727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:10 devstack sudo[83727]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:10 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:10 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:10 devstack sudo[83730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:06:10 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:10 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:10 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:10 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:06:10 devstack sudo[83787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:06:10 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:06:11 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root
Jun 24 04:06:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:06:11 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-41d78e22-2656-4718-81e3-68eed5a6f113 None None] Driver post RPC initialization completed successfully.
Jun 24 04:06:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:06:11 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:06:11 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread info: [<_MainThread(MainThread, started 139615466774656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139615359582656)>, <Thread(Thread-3 (stat_writer), started daemon 139615359487168)>, <Thread(Rabbit-heartbeat, started daemon 139615358621248)>, <Thread(Thread-5 (_runner), started daemon 139615354718976)>, <Thread(Thread-7 (_runner), started daemon 139615354820608)>] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:06:18 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=3 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:06:21 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:07:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:07:11 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:07:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:07:11 devstack sudo[85519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:07:11 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:07:12 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root
Jun 24 04:07:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:07:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:07:12 devstack sudo[85522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:07:12 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:07:12 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root
Jun 24 04:07:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:07:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:07:12 devstack sudo[85525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:07:12 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:07:13 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root
Jun 24 04:07:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:07:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:07:13 devstack sudo[85528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:07:13 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:07:14 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root
Jun 24 04:07:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:07:14 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:07:14 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:07:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:07:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread info: [<_MainThread(MainThread, started 139615466774656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139615359582656)>, <Thread(Thread-3 (stat_writer), started daemon 139615359487168)>, <Thread(Rabbit-heartbeat, started daemon 139615358621248)>, <Thread(Thread-5 (_runner), started daemon 139615354718976)>, <Thread(Thread-7 (_runner), started daemon 139615354820608)>] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:08:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:08:11 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:08:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:08:11 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:08:11 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:08:12 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Jun 24 04:08:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:08:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:08:12 devstack sudo[88809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:08:12 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:08:12 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root
Jun 24 04:08:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:08:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:08:12 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:08:12 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:08:13 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Jun 24 04:08:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:08:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:08:13 devstack sudo[88821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:08:13 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:08:13 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root
Jun 24 04:08:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:08:13 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:08:13 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:08:13 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:08:13 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread info: [<_MainThread(MainThread, started 139615466774656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139615359582656)>, <Thread(Thread-3 (stat_writer), started daemon 139615359487168)>, <Thread(Rabbit-heartbeat, started daemon 139615358621248)>, <Thread(Thread-5 (_runner), started daemon 139615354718976)>, <Thread(Thread-7 (_runner), started daemon 139615354820608)>] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:08:21 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:08:21 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:UPDATE=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:09:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:09:11 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:09:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:09:11 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:09:11 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:09:11 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Jun 24 04:09:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:09:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:09:12 devstack sudo[90217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:09:12 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:09:12 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root
Jun 24 04:09:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:09:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:09:12 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:09:12 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:09:13 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Jun 24 04:09:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.656s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:09:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:09:13 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:09:13 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:09:13 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Jun 24 04:09:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:09:13 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:09:14 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:09:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:09:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread info: [<_MainThread(MainThread, started 139615466774656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139615359582656)>, <Thread(Thread-3 (stat_writer), started daemon 139615359487168)>, <Thread(Rabbit-heartbeat, started daemon 139615358621248)>, <Thread(Thread-5 (_runner), started daemon 139615354718976)>, <Thread(Thread-7 (_runner), started daemon 139615354820608)>] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:10:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:10:11 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jun 24 04:10:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:11 devstack sudo[91676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jun 24 04:10:11 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:12 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:12 devstack sudo[91680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:10:12 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:12 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:12 devstack sudo[91694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jun 24 04:10:12 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:13 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:13 devstack sudo[91720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jun 24 04:10:13 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:13 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:13 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:10:13 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:10:13 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:10:13 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-bc28b7e3-c2fa-4b50-86ad-8e692fa1e13c None None] thread info: [<_MainThread(MainThread, started 139615466774656)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139615359582656)>, <Thread(Thread-3 (stat_writer), started daemon 139615359487168)>, <Thread(Rabbit-heartbeat, started daemon 139615358621248)>, <Thread(Thread-5 (_runner), started daemon 139615354718976)>, <Thread(Thread-7 (_runner), started daemon 139615354820608)>] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:10:21 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:10:21 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:UPDATE=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:10:51 devstack cinder-volume[82439]: INFO oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Caught SIGTERM, stopping children
Jun 24 04:10:51 devstack cinder-volume[82439]: DEBUG oslo_concurrency.lockutils [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Acquiring lock "singleton_lock" {{(pid=82439) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:10:51 devstack cinder-volume[82439]: DEBUG oslo_concurrency.lockutils [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Acquired lock "singleton_lock" {{(pid=82439) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:10:51 devstack cinder-volume[82439]: DEBUG oslo_concurrency.lockutils [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Releasing lock "singleton_lock" {{(pid=82439) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:10:51 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Stop services. {{(pid=82439) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 24 04:10:51 devstack cinder-volume[82439]: DEBUG oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Killing children. {{(pid=82439) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 24 04:10:51 devstack cinder-volume[82439]: INFO oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Waiting on 1 children to exit
Jun 24 04:10:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Acquiring lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:10:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Acquired lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:10:53 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Releasing lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:10:53 devstack cinder-volume[82604]: WARNING amqp [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 24 04:10:53 devstack cinder-volume[82604]: WARNING amqp [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 24 04:10:53 devstack cinder-volume[82439]: INFO oslo_service.backend._eventlet.service [None req-0b8808eb-35ec-4250-93ce-122b0a21162e None None] Child 82604 exited with status 0
Jun 24 04:10:54 devstack cinder-volume[92699]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 24 04:10:54 devstack cinder-volume[92699]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:10:54 devstack cinder-volume[92699]: we strongly recommend against using it for new projects.
Jun 24 04:10:54 devstack cinder-volume[92699]: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:10:54 devstack cinder-volume[92699]: framework.  For more detail see
Jun 24 04:10:54 devstack cinder-volume[92699]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:10:54 devstack cinder-volume[92699]:   import eventlet  # noqa
Jun 24 04:10:56 devstack cinder-volume[92699]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:10:56 devstack cinder-volume[92699]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:10:56 devstack cinder-volume[92699]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:10:56 devstack cinder-volume[92699]: INFO dbcounter [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Registered counter for database cinder
Jun 24 04:10:56 devstack cinder-volume[92699]: DEBUG oslo_db.sqlalchemy.engines [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG dbcounter [-] [92699] Writer thread running {{(pid=92699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:10:57 devstack cinder-volume[92699]: INFO cinder.rpc [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 24 04:10:57 devstack cinder-volume[92699]: INFO cinder.rpc [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_db.sqlalchemy.engines [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:10:57 devstack cinder-volume[92699]: INFO cinder.volume.manager [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Determined volume DB was empty at startup.
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG cinder.volume.manager [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92699) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 24 04:10:57 devstack cinder-volume[92699]: INFO cinder.volume.manager [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Service not found for updating active_backend_id, assuming default for driver init.
Jun 24 04:10:57 devstack cinder-volume[92699]: WARNING stevedore.named [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 24 04:10:57 devstack cinder-volume[92699]: WARNING castellan.key_manager [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:10:57 devstack cinder-volume[92699]: WARNING cinder.keymgr.conf_key_mgr [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:10:57 devstack cinder-volume[92699]: INFO cinder.volume.manager [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_db.sqlalchemy.engines [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:10:57 devstack cinder-volume[92699]: INFO oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Starting 1 workers
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Started child 92915 {{(pid=92699) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Full set of CONF: {{(pid=92699) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] ******************************************************************************** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Configuration options gathered from: {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] ================================================================================ {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] allow_availability_zone_fallback = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] allow_compression_on_image_upload = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] allowed_direct_url_schemes     = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] api_rate_limit                 = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] auth_strategy                  = keystone {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_availability_zone      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_host                   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_name                   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_stats_polling_interval = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backup_api_class               = cinder.backup.api.API {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backup_name_template           = backup-%s {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backup_use_same_host           = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backup_use_temp_snapshot       = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] chap_password                  = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] chap_username                  =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_internal_tenant_project_id = fffc6d19eedd4c16a84de413d08c6f7f {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_internal_tenant_user_id = 3564b180cf0f4af5a90fc4e80efa264f {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cluster                        = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] compression_format             = gzip {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] compute_api_class              = cinder.compute.nova.API {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] config_dir                     = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] config_source                  = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92915]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] control_exchange               = openstack {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] debug                          = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] default_availability_zone      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] default_group_type             = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] default_volume_type            = QuobyteHD {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] disk_geometry                  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] driver_client_cert             = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] driver_client_cert_key         = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] driver_data_namespace          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] driver_ssl_cert_path           = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] driver_ssl_cert_verify         = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] driver_use_ssl                 = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] enable_new_services            = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] enable_unsupported_driver      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] enabled_backends               = ['QuobyteHD'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] enforce_multipath_for_image_xfer = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] filter_function                = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_api_insecure            = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_api_servers             = ['http://192.168.122.16/image'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_api_ssl_compression     = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_ca_certificates_file    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_catalog_info            = image:glance:publicURL {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_certfile                = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_keyfile                 = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_num_retries             = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance_request_timeout         = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] goodness_function              = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] graceful_shutdown_timeout      = 5 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] group_api_class                = cinder.group.api.API {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] host                           = devstack {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_compress_on_upload       = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_conversion_address_space_limit = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_conversion_cpu_limit     = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_conversion_disable       = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_upload_use_cinder_backend = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_upload_use_internal_tenant = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_volume_cache_enabled     = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_volume_cache_max_count   = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] image_volume_cache_max_size_gb = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] init_host_max_objects_retrieval = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] instance_format                = [instance: %(uuid)s]  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] iscsi_target_flags             =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] iscsi_write_cache              = on {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] iser_helper                    = tgtadm {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] iser_ip_address                = 192.168.122.16 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] iser_port                      = 3260 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_color                      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_config_append              = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_dir                        = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_file                       = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_options                    = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_rotate_interval            = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_rotate_interval_type       = days {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] log_rotation_type              = none {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] max_age                        = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] max_logfile_count              = 30 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] max_logfile_size_mb            = 200 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] max_over_subscription_ratio    = 20.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] message_reap_interval          = 86400 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] message_ttl                    = 2592000 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] migration_create_volume_timeout_secs = 300 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] monkey_patch                   = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] monkey_patch_modules           = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] my_ip                          = 192.168.122.16 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] no_snapshot_gb_quota           = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] num_iser_scan_tries            = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] num_shell_tries                = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] num_volume_device_scan_tries   = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] nvmeof_conn_info_version       = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] nvmet_ns_id                    = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] nvmet_port_id                  = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] osapi_max_limit                = 1000 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] osapi_volume_ext_list          = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] osapi_volume_listen_port       = 8776 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] osapi_volume_use_ssl           = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] osapi_volume_workers           = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] per_volume_size_limit          = -1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] periodic_fuzzy_delay           = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] periodic_interval              = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] public_endpoint                = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] publish_errors                 = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] quota_backup_gigabytes         = 1000 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] quota_backups                  = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] quota_gigabytes                = 1000 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] quota_groups                   = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] quota_snapshots                = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] quota_volumes                  = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] rate_limit_burst               = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] rate_limit_except_level        = CRITICAL {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] rate_limit_interval            = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] reinit_driver_count            = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] replication_device             = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] report_discard_supported       = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] report_interval                = 120 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] reservation_clean_interval     = 86400 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] reservation_expire             = 86400 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] reserved_image_namespaces      = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] reserved_percentage            = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] rpc_response_timeout           = 120 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] run_external_periodic_tasks    = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] scst_target_driver             = iscsi {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] scst_target_iqn_name           = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_down_time              = 720 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] shell_completion               = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] snapshot_name_template         = snapshot-%s {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] split_loggers                  = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] state_path                     = /opt/stack/data/cinder {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] storage_availability_zone      = nova {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] storage_protocol               = iSCSI {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] syslog_log_facility            = LOG_USER {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] target_helper                  = lioadm {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] target_ip_address              = 192.168.122.16 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] target_port                    = 3260 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] target_protocol                = iscsi {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] target_secondary_ip_addresses  = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] trace_flags                    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] transport_url                  = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] until_refresh                  = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] use_chap_auth                  = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] use_default_quota_class        = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] use_journal                    = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] use_json                       = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] use_multipath_for_image_xfer   = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] use_stderr                     = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] use_syslog                     = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] verify_glance_signatures       = enabled {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_api_class               = cinder.volume.api.API {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_backend_name            = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_clear                   = zero {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_clear_ionice            = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_clear_size              = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_copy_bps_limit          = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_dd_blocksize            = 1M {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_name_template           = volume-%s {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_service_inithost_offload = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volume_usage_audit_period      = month {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] zoning_mode                    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_concurrency.disable_process_locking = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.auth_section = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.auth_type   = password {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.auth_version = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.cache       = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.certfile    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.delay_auth_decision = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.http_connect_timeout = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.include_service_catalog = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.insecure    = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.interface   = public {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.keyfile     = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_password =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcache_username =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.region_name = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.service_token_roles_required = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.service_type = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.token_cache_time = 300 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.backend                  = dogpile.cache.null {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.backend_argument         = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.backend_expiration_time  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.config_prefix            = cache.oslo {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.debug_cache_backend      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.enable_retry_client      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.enable_socket_keepalive  = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.enabled                  = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.expiration_time          = 600 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.hashclient_retry_attempts = 2 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.memcache_dead_retry      = 300 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.memcache_pool_maxsize    = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.memcache_sasl_enabled    = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.password                 = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.proxies                  = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.redis_db                 = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.redis_sentinel_service_name = mymaster {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.redis_server             = localhost:6379 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.retry_attempts           = 2 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.retry_delay              = 0.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.socket_keepalive_count   = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.socket_keepalive_idle    = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.socket_keepalive_interval = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.socket_timeout           = 1.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.tls_allowed_ciphers      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.tls_cafile               = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.tls_certfile             = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.tls_enabled              = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92915]: INFO cinder.volume.manager [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.tls_keyfile              = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.remotefs [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92915) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cache.username                 = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] coordination.backend_url       = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.asyncio_connection    = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.asyncio_slave_connection = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.backend               = sqlalchemy {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.connection            = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.connection_debug      = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.connection_parameters =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.connection_recycle_time = 3600 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.connection_trace      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.db_inc_retry_interval = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.db_max_retries        = 20 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.db_max_retry_interval = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.db_retry_interval     = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.max_overflow          = 50 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.max_pool_size         = 5 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.max_retries           = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.mysql_wsrep_sync_wait = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.pool_timeout          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.retry_interval        = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.slave_connection      = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.sqlite_synchronous    = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.synchronous_reader    = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] database.use_db_reconnect      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.connection_string     = messaging:// {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.enabled               = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.es_doc_type           = notification {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.es_scroll_size        = 10000 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.es_scroll_time        = 2m {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.filter_error_trace    = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.hmac_keys             = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.sentinel_service_name = mymaster {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.socket_timeout        = 0.1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.trace_requests        = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler.trace_sqlalchemy      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler_jaeger.process_tags   = {} {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler_jaeger.service_name_prefix = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] profiler_otlp.service_name_prefix = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.enforce_new_defaults = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: WARNING oslo_config.cfg [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.enforce_scope      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.policy_default_rule = default {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.policy_file        = policy.yaml {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] privsep_osbrick.group          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] privsep_osbrick.helper_command = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] privsep_osbrick.user           = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_sys_admin.group         = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_sys_admin.helper_command = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] cinder_sys_admin.user          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.auth_section      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.auth_type         = password {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.cafile            = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.certfile          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.collect_timing    = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.insecure          = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.keyfile           = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.send_service_user_token = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.split_loggers     = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] service_user.timeout           = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.auth_section            = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.auth_type               = password {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.certfile                = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.collect_timing          = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.insecure                = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.keyfile                 = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.region_name             = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.split_loggers           = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] glance.timeout                 = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.backend_availability_zone = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.chap_password = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.chap_username =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.disk_geometry = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.driver_client_cert = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.driver_client_cert_key = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.driver_data_namespace = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.driver_use_ssl = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.enable_unsupported_driver = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.extra_capabilities = {} {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.filter_function = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.goodness_function = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.iscsi_target_flags =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.iscsi_write_cache = on {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.iser_helper   = tgtadm {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.iser_port     = 3260 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_host      =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_login     = admin {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_mount_options = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_password  = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_private_key =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_share_path =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_ssh_port  = 22 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.num_shell_tries = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.nvmet_port_id = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.quobyte_client_cfg = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.quobyte_volume_url = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.replication_device = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.report_discard_supported = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.reserved_percentage = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.scst_target_driver = iscsi {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.scst_target_iqn_name = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.storage_protocol = iSCSI {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.target_helper = tgtadm {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.target_port   = 3260 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.target_protocol = iscsi {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.trace_flags   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.unique_fqdn_network = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.use_chap_auth = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volume_backend_name = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volume_clear  = zero {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volume_clear_ionice = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volume_clear_size = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_reports.file_event_handler = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_reports.log_dir           = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.backend_availability_zone = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.backend_host         = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.chap_password        = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.chap_username        = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.chiscsi_conf         = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.disk_geometry        = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.driver_client_cert   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.driver_client_cert_key = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.driver_data_namespace = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.driver_use_ssl       = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.extra_capabilities   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.filter_function      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.goodness_function    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92915) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.iscsi_target_flags   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.iscsi_write_cache    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.iser_helper          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.iser_ip_address      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.iser_port            = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.iser_target_prefix   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_host             = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_login            = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_mount_options    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_password         = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_private_key      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_share_path       = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_ssh_port         = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92915]: WARNING cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 24 04:10:57 devstack cinder-volume[92915]: WARNING cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.num_shell_tries      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nvmet_ns_id          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.nvmet_port_id        = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Running cmd (subprocess): mount.quobyte {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.replication_device   = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.report_discard_supported = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.reserved_percentage  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.scst_target_driver   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.storage_protocol     = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.target_helper        = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.target_ip_address    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.target_port          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.target_prefix        = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.target_protocol      = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.trace_flags          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.unique_fqdn_network  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.use_chap_auth        = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volume_clear         = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volume_clear_ionice  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volume_clear_size    = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] QuobyteHD.volumes_dir          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.ssl      = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_notifications.driver = [] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_notifications.retry = -1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] oslo_messaging_notifications.transport_url = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] key_manager.fixed_key          = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.barbican_api_version  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.barbican_endpoint     = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.barbican_endpoint_type = public {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.barbican_region_name  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.cafile                = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.certfile              = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.collect_timing        = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.insecure              = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.keyfile               = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.number_of_retries     = 60 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.retry_delay           = 1 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.send_service_user_token = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.split_loggers         = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.timeout               = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.verify_ssl            = True {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican.verify_ssl_path       = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.auth_section = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.auth_type = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.cafile   = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.certfile = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.collect_timing = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.insecure = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.keyfile  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.split_loggers = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] barbican_service_user.timeout  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.approle_role_id          = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.approle_secret_id        = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.kv_mountpoint            = secret {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.kv_path                  = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.kv_version               = 2 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.namespace                = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.root_token_id            = **** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.ssl_ca_crt_file          = None {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.timeout                  = 60.0 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.use_ssl                  = False {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:10:57 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] ******************************************************************************** {{(pid=92699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 24 04:10:57 devstack quobyte-client[92920]: Reading configuration file: /etc/quobyte/client.cfg
Jun 24 04:10:57 devstack quobyte-client[92920]: Invalid parameters found, error: missing mount point.
Jun 24 04:10:57 devstack quobyte-client[92920]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 24 04:10:57 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:57 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:10:57 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:10:57 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=92915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:10:57 devstack quobyte-client[92920]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 24 04:10:57 devstack cinder-volume[92915]: INFO cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e ...
Jun 24 04:10:57 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 -c /etc/quobyte/client-cinder.cfg {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:57 devstack sudo[92921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 -c /etc/quobyte/client-cinder.cfg
Jun 24 04:10:57 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:58 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:58 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.759s {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:58 devstack cinder-volume[92915]: INFO cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e succeeded
Jun 24 04:10:58 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=92915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:10:58 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.772s {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:10:58 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:58 devstack sudo[92990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:10:58 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:10:59 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.640s {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:10:59 devstack cinder-volume[92915]: INFO cinder.volume.driver [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Driver hasn't implemented _init_vendor_properties()
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG cinder.volume.driver [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92915) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG oslo_db.sqlalchemy.engines [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92915) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG dbcounter [-] [92915] Writer thread running {{(pid=92915) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG cinder.db.api [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Building query based on filter {{(pid=92915) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG cinder.image.image_utils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92915) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 24 04:10:59 devstack cinder-volume[92915]: INFO cinder.keymgr.migration [None req-8f0a74b8-d7c9-4e21-afad-d09b549a0fed None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=92915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=92915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:10:59 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:10:59 devstack sudo[92993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:10:59 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:00 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.673s {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG cinder.manager [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Notifying Schedulers of capabilities ... {{(pid=92915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:11:00 devstack cinder-volume[92915]: INFO cinder.volume.manager [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Driver initialization completed successfully.
Jun 24 04:11:00 devstack cinder-volume[92915]: INFO cinder.manager [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Initiating service 3 cleanup
Jun 24 04:11:00 devstack cinder-volume[92915]: INFO cinder.manager [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Service 3 cleanup completed.
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG cinder.service [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Creating RPC server for service cinder-volume {{(pid=92915) start /opt/stack/cinder/cinder/service.py:231}}
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG cinder.service [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92915) start /opt/stack/cinder/cinder/service.py:237}}
Jun 24 04:11:00 devstack cinder-volume[92915]: INFO cinder.volume.manager [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=92915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=92915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:00 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:00 devstack sudo[93000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:11:00 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:01 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:01 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.795s {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:01 devstack cinder-volume[92915]: INFO cinder.volume.manager [None req-0f877c57-1089-4e7d-896b-ebfb0f72f1c0 None None] Driver post RPC initialization completed successfully.
Jun 24 04:11:04 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-2a04daf7-fd57-4b65-8512-d4c699022c17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:04 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-2a04daf7-fd57-4b65-8512-d4c699022c17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:04 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-2a04daf7-fd57-4b65-8512-d4c699022c17 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=92915) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:04 devstack cinder-volume[92915]: DEBUG cinder.volume.drivers.quobyte [None req-2a04daf7-fd57-4b65-8512-d4c699022c17 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=92915) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:04 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-2a04daf7-fd57-4b65-8512-d4c699022c17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92915) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:04 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-2a04daf7-fd57-4b65-8512-d4c699022c17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:05 devstack sudo[93115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:11:05 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:05 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:05 devstack cinder-volume[92915]: DEBUG oslo_concurrency.processutils [None req-2a04daf7-fd57-4b65-8512-d4c699022c17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.591s {{(pid=92915) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:05 devstack cinder-volume[92915]: DEBUG cinder.manager [None req-2a04daf7-fd57-4b65-8512-d4c699022c17 None None] Notifying Schedulers of capabilities ... {{(pid=92915) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:11:07 devstack cinder-volume[92699]: INFO oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Caught SIGTERM, stopping children
Jun 24 04:11:07 devstack cinder-volume[92699]: DEBUG oslo_concurrency.lockutils [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Acquiring lock "singleton_lock" {{(pid=92699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:07 devstack cinder-volume[92699]: DEBUG oslo_concurrency.lockutils [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Acquired lock "singleton_lock" {{(pid=92699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:07 devstack cinder-volume[92699]: DEBUG oslo_concurrency.lockutils [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Releasing lock "singleton_lock" {{(pid=92699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:07 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Stop services. {{(pid=92699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jun 24 04:11:07 devstack cinder-volume[92699]: DEBUG oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Killing children. {{(pid=92699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jun 24 04:11:07 devstack cinder-volume[92699]: INFO oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Waiting on 1 children to exit
Jun 24 04:11:08 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Acquiring lock "singleton_lock" {{(pid=92915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:08 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Acquired lock "singleton_lock" {{(pid=92915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:08 devstack cinder-volume[92915]: DEBUG oslo_concurrency.lockutils [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Releasing lock "singleton_lock" {{(pid=92915) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:08 devstack cinder-volume[92915]: WARNING amqp [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 24 04:11:08 devstack cinder-volume[92915]: WARNING amqp [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jun 24 04:11:08 devstack cinder-volume[92699]: INFO oslo_service.backend._eventlet.service [None req-c9d33bb2-66aa-4417-b75f-b84c66f3c4bd None None] Child 92915 exited with status 0
Jun 24 04:11:09 devstack cinder-volume[93192]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jun 24 04:11:09 devstack cinder-volume[93192]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:11:09 devstack cinder-volume[93192]: we strongly recommend against using it for new projects.
Jun 24 04:11:09 devstack cinder-volume[93192]: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:11:09 devstack cinder-volume[93192]: framework.  For more detail see
Jun 24 04:11:09 devstack cinder-volume[93192]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:11:09 devstack cinder-volume[93192]:   import eventlet  # noqa
Jun 24 04:11:12 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jun 24 04:11:12 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jun 24 04:11:12 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jun 24 04:11:13 devstack cinder-volume[93192]: INFO dbcounter [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Registered counter for database cinder
Jun 24 04:11:13 devstack cinder-volume[93192]: DEBUG oslo_db.sqlalchemy.engines [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:13 devstack cinder-volume[93192]: DEBUG dbcounter [-] [93192] Writer thread running {{(pid=93192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:11:13 devstack cinder-volume[93192]: INFO cinder.rpc [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jun 24 04:11:13 devstack cinder-volume[93192]: INFO cinder.rpc [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_db.sqlalchemy.engines [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:14 devstack cinder-volume[93192]: INFO cinder.volume.manager [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Determined volume DB was empty at startup.
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG cinder.volume.manager [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93192) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jun 24 04:11:14 devstack cinder-volume[93192]: WARNING stevedore.named [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jun 24 04:11:14 devstack cinder-volume[93192]: WARNING castellan.key_manager [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:11:14 devstack cinder-volume[93192]: WARNING cinder.keymgr.conf_key_mgr [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jun 24 04:11:14 devstack cinder-volume[93192]: INFO cinder.volume.manager [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_db.sqlalchemy.engines [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:14 devstack cinder-volume[93192]: INFO oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Starting 1 workers
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Started child 93468 {{(pid=93192) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Full set of CONF: {{(pid=93192) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] ******************************************************************************** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Configuration options gathered from: {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] ================================================================================ {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jun 24 04:11:14 devstack cinder-volume[93468]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] allow_availability_zone_fallback = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] allow_compression_on_image_upload = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] allowed_direct_url_schemes     = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] api_rate_limit                 = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] auth_strategy                  = keystone {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_availability_zone      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_host                   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_name                   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_stats_polling_interval = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backup_api_class               = cinder.backup.api.API {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backup_name_template           = backup-%s {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backup_use_same_host           = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backup_use_temp_snapshot       = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] chap_password                  = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] chap_username                  =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_internal_tenant_project_id = fffc6d19eedd4c16a84de413d08c6f7f {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_internal_tenant_user_id = 3564b180cf0f4af5a90fc4e80efa264f {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cluster                        = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] compression_format             = gzip {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] compute_api_class              = cinder.compute.nova.API {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] config_dir                     = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] config_source                  = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] control_exchange               = openstack {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] debug                          = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] default_availability_zone      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] default_group_type             = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] default_volume_type            = QuobyteHD {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] disk_geometry                  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] driver_client_cert             = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] driver_client_cert_key         = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] driver_data_namespace          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] driver_ssl_cert_path           = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] driver_ssl_cert_verify         = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] driver_use_ssl                 = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] enable_new_services            = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] enable_unsupported_driver      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] enabled_backends               = ['QuobyteHD'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] enforce_multipath_for_image_xfer = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] filter_function                = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_api_insecure            = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_api_servers             = ['http://192.168.122.16/image'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_api_ssl_compression     = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_ca_certificates_file    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_catalog_info            = image:glance:publicURL {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_certfile                = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_keyfile                 = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_num_retries             = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance_request_timeout         = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] goodness_function              = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] graceful_shutdown_timeout      = 5 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] group_api_class                = cinder.group.api.API {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] host                           = devstack {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_compress_on_upload       = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_conversion_address_space_limit = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_conversion_cpu_limit     = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_conversion_disable       = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_upload_use_cinder_backend = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_upload_use_internal_tenant = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_volume_cache_enabled     = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_volume_cache_max_count   = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] image_volume_cache_max_size_gb = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] init_host_max_objects_retrieval = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] instance_format                = [instance: %(uuid)s]  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] iscsi_target_flags             =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] iscsi_write_cache              = on {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] iser_helper                    = tgtadm {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] iser_ip_address                = 192.168.122.16 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] iser_port                      = 3260 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_color                      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_config_append              = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_dir                        = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_file                       = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_options                    = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_rotate_interval            = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_rotate_interval_type       = days {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] log_rotation_type              = none {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] max_age                        = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] max_logfile_count              = 30 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] max_logfile_size_mb            = 200 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] max_over_subscription_ratio    = 20.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] message_reap_interval          = 86400 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] message_ttl                    = 2592000 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] migration_create_volume_timeout_secs = 300 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] monkey_patch                   = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] monkey_patch_modules           = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] my_ip                          = 192.168.122.16 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] no_snapshot_gb_quota           = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] num_iser_scan_tries            = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Starting volume driver QuobyteDriver (1.1.14)
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] num_shell_tries                = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93468) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] num_volume_device_scan_tries   = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] nvmeof_conn_info_version       = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] nvmet_ns_id                    = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] nvmet_port_id                  = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] osapi_max_limit                = 1000 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] osapi_volume_ext_list          = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] osapi_volume_listen_port       = 8776 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] osapi_volume_use_ssl           = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] osapi_volume_workers           = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] per_volume_size_limit          = -1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] periodic_fuzzy_delay           = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] periodic_interval              = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] public_endpoint                = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] publish_errors                 = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] quota_backup_gigabytes         = 1000 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] quota_backups                  = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] quota_gigabytes                = 1000 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] quota_groups                   = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] quota_snapshots                = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] quota_volumes                  = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] rate_limit_burst               = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] rate_limit_except_level        = CRITICAL {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] rate_limit_interval            = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] reinit_driver_count            = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] replication_device             = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] report_discard_supported       = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] report_interval                = 120 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] reservation_clean_interval     = 86400 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] reservation_expire             = 86400 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] reserved_image_namespaces      = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] reserved_percentage            = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] rpc_response_timeout           = 120 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] run_external_periodic_tasks    = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] scst_target_driver             = iscsi {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] scst_target_iqn_name           = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_down_time              = 720 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] shell_completion               = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] snapshot_name_template         = snapshot-%s {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] split_loggers                  = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] state_path                     = /opt/stack/data/cinder {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] storage_availability_zone      = nova {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] storage_protocol               = iSCSI {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] syslog_log_facility            = LOG_USER {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] target_helper                  = lioadm {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] target_ip_address              = 192.168.122.16 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] target_port                    = 3260 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] target_protocol                = iscsi {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] target_secondary_ip_addresses  = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] trace_flags                    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] transport_url                  = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] until_refresh                  = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] use_chap_auth                  = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] use_default_quota_class        = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] use_journal                    = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] use_json                       = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] use_multipath_for_image_xfer   = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] use_stderr                     = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] use_syslog                     = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] verify_glance_signatures       = enabled {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_api_class               = cinder.volume.api.API {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_backend_name            = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_clear                   = zero {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_clear_ionice            = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_clear_size              = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_copy_bps_limit          = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_dd_blocksize            = 1M {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_name_template           = volume-%s {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_service_inithost_offload = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volume_usage_audit_period      = month {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] zoning_mode                    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_concurrency.disable_process_locking = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.auth_section = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.auth_type   = password {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.auth_version = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.cache       = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.certfile    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.delay_auth_decision = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.http_connect_timeout = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.include_service_catalog = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.insecure    = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.interface   = public {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.keyfile     = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_password =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcache_username =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.region_name = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.service_token_roles_required = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.service_type = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.token_cache_time = 300 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.backend                  = dogpile.cache.null {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.backend_argument         = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.backend_expiration_time  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.config_prefix            = cache.oslo {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.debug_cache_backend      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.enable_retry_client      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.enable_socket_keepalive  = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.enabled                  = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.expiration_time          = 600 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.hashclient_retry_attempts = 2 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.memcache_dead_retry      = 300 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.memcache_pool_maxsize    = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.memcache_sasl_enabled    = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.password                 = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.proxies                  = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.redis_db                 = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.redis_sentinel_service_name = mymaster {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.redis_server             = localhost:6379 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.retry_attempts           = 2 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.retry_delay              = 0.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.socket_keepalive_count   = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.socket_keepalive_idle    = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.socket_keepalive_interval = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.socket_timeout           = 1.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.tls_allowed_ciphers      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.tls_cafile               = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.tls_certfile             = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.tls_enabled              = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93468) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jun 24 04:11:14 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jun 24 04:11:14 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.tls_keyfile              = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cache.username                 = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] coordination.backend_url       = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Running cmd (subprocess): mount.quobyte {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.asyncio_connection    = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.asyncio_slave_connection = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.backend               = sqlalchemy {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.connection            = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.connection_debug      = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.connection_parameters =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.connection_recycle_time = 3600 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.connection_trace      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.db_inc_retry_interval = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.db_max_retries        = 20 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.db_max_retry_interval = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.db_retry_interval     = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.max_overflow          = 50 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.max_pool_size         = 5 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.max_retries           = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.mysql_wsrep_sync_wait = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.pool_timeout          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.retry_interval        = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.slave_connection      = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.sqlite_synchronous    = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.synchronous_reader    = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] database.use_db_reconnect      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.connection_string     = messaging:// {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.enabled               = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.es_doc_type           = notification {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.es_scroll_size        = 10000 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.es_scroll_time        = 2m {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.filter_error_trace    = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.hmac_keys             = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.sentinel_service_name = mymaster {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.socket_timeout        = 0.1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.trace_requests        = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler.trace_sqlalchemy      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler_jaeger.process_tags   = {} {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler_jaeger.service_name_prefix = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] profiler_otlp.service_name_prefix = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.enforce_new_defaults = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: WARNING oslo_config.cfg [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.enforce_scope      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.policy_default_rule = default {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.policy_file        = policy.yaml {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] privsep_osbrick.group          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] privsep_osbrick.helper_command = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] privsep_osbrick.user           = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_sys_admin.group         = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_sys_admin.helper_command = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] cinder_sys_admin.user          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.auth_section      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.auth_type         = password {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.cafile            = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.certfile          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.collect_timing    = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.insecure          = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.keyfile           = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.send_service_user_token = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.split_loggers     = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] service_user.timeout           = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.auth_section            = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.auth_type               = password {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.certfile                = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.collect_timing          = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.insecure                = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.keyfile                 = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.region_name             = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.split_loggers           = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] glance.timeout                 = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.backend_availability_zone = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.chap_password = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.chap_username =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.disk_geometry = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.driver_client_cert = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.driver_client_cert_key = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.driver_data_namespace = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.driver_use_ssl = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.enable_unsupported_driver = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.extra_capabilities = {} {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.filter_function = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.goodness_function = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.iscsi_target_flags =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.iscsi_write_cache = on {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.iser_helper   = tgtadm {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.iser_port     = 3260 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_host      =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_login     = admin {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_mount_options = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_password  = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_private_key =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_share_path =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.num_shell_tries = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.nvmet_port_id = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.quobyte_client_cfg = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.quobyte_volume_url = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.replication_device = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.report_discard_supported = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.reserved_percentage = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.scst_target_driver = iscsi {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.scst_target_iqn_name = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.storage_protocol = iSCSI {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.target_helper = tgtadm {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.target_port   = 3260 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack quobyte-client[93469]: Reading configuration file: /etc/quobyte/client.cfg
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.target_protocol = iscsi {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.trace_flags   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.unique_fqdn_network = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.use_chap_auth = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack quobyte-client[93469]: Invalid parameters found, error: missing mount point.
Jun 24 04:11:14 devstack quobyte-client[93469]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volume_backend_name = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack quobyte-client[93469]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volume_clear  = zero {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volume_clear_ionice = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volume_clear_size = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] CMD "mount.quobyte" returned: 1 in 0.121s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_reports.file_event_handler = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_reports.log_dir           = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.backend_availability_zone = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.backend_host         = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.chap_password        = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.chap_username        = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.chiscsi_conf         = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.disk_geometry        = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.driver_client_cert   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.driver_client_cert_key = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.driver_data_namespace = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.driver_use_ssl       = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.extra_capabilities   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.filter_function      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.goodness_function    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.iser_helper          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.iser_ip_address      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.iser_port            = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.iser_target_prefix   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_host             = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_login            = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_mount_options    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_password         = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_private_key      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_share_path       = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_ssh_port         = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.num_shell_tries      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.nvmet_port_id        = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.replication_device   = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.report_discard_supported = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.reserved_percentage  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.scst_target_driver   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.storage_protocol     = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.target_helper        = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.target_ip_address    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.target_port          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.target_prefix        = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.target_protocol      = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.trace_flags          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.use_chap_auth        = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volume_clear         = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volume_clear_size    = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack sudo[93470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:11:14 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] QuobyteHD.volumes_dir          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.ssl      = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_notifications.driver = [] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_notifications.retry = -1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] oslo_messaging_notifications.transport_url = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] key_manager.fixed_key          = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.barbican_api_version  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.barbican_endpoint     = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.barbican_endpoint_type = public {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.barbican_region_name  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.cafile                = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.certfile              = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.collect_timing        = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.insecure              = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.keyfile               = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.number_of_retries     = 60 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.retry_delay           = 1 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.send_service_user_token = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.split_loggers         = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.timeout               = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.verify_ssl            = True {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican.verify_ssl_path       = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.auth_section = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.auth_type = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.cafile   = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.certfile = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.collect_timing = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.insecure = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.keyfile  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.split_loggers = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] barbican_service_user.timeout  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.approle_role_id          = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.approle_secret_id        = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.kv_mountpoint            = secret {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.kv_path                  = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.kv_version               = 2 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.namespace                = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.root_token_id            = **** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.ssl_ca_crt_file          = None {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.timeout                  = 60.0 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.use_ssl                  = False {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jun 24 04:11:14 devstack cinder-volume[93192]: DEBUG oslo_service.backend._eventlet.service [None req-4ac96d9f-b22f-4969-99dc-4ee525e8238f None None] ******************************************************************************** {{(pid=93192) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jun 24 04:11:15 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.643s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:15 devstack cinder-volume[93468]: INFO cinder.volume.driver [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Driver hasn't implemented _init_vendor_properties()
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG cinder.volume.driver [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93468) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG oslo_db.sqlalchemy.engines [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writer thread running {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG cinder.db.api [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Building query based on filter {{(pid=93468) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93468) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:15 devstack cinder-volume[93468]: INFO cinder.keymgr.migration [None req-f54f980b-b03c-4794-8680-87b139ab0878 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jun 24 04:11:15 devstack sudo[93492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:11:15 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:15 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.605s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:15 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:11:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Driver initialization completed successfully.
Jun 24 04:11:15 devstack cinder-volume[93468]: INFO cinder.manager [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Initiating service 3 cleanup
Jun 24 04:11:16 devstack cinder-volume[93468]: INFO cinder.manager [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Service 3 cleanup completed.
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG cinder.service [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Creating RPC server for service cinder-volume {{(pid=93468) start /opt/stack/cinder/cinder/service.py:231}}
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG cinder.service [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93468) start /opt/stack/cinder/cinder/service.py:237}}
Jun 24 04:11:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:11:16 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:11:16 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:11:16 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Jun 24 04:11:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.638s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:11:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-651629f2-a417-4b69-8439-0ee727f1afef None None] Driver post RPC initialization completed successfully.
Jun 24 04:11:24 devstack cinder-volume[93192]: DEBUG dbcounter [-] [93192] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:11:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b2097bef-8223-4478-88cf-ad9006aa30a3 tempest-BackendsCapabilitiesAdminTestsJSON-1390474336 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93468) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 24 04:11:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ebd62d-9833-4622-87e8-7f0f4095c128 tempest-BackendsCapabilitiesAdminTestsJSON-1390474336 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93468) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jun 24 04:11:26 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:11:26 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:12:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:12:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 6 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:12:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:12:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-eef1f305-7ee0-4af3-a1be-063b7b5a40c0 tempest-GroupsV314Test-218288902 None] Group tempest-GroupsV314Test-Group-370777077: creating
Jun 24 04:12:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-eef1f305-7ee0-4af3-a1be-063b7b5a40c0 tempest-GroupsV314Test-218288902 None] Group tempest-GroupsV314Test-Group-370777077: created successfully
Jun 24 04:12:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-eef1f305-7ee0-4af3-a1be-063b7b5a40c0 tempest-GroupsV314Test-218288902 None] Create group completed successfully.
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Flow 'volume_create_manager' (e275e8d9-8969-444c-8a56-387628a1437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9326d5c4-d88e-4b02-a613-f524a4d0e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9326d5c4-d88e-4b02-a613-f524a4d0e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78512669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=57209e65-f139-419a-9a5d-c50a3dc64b02,host='devstack@QuobyteHD#QuobyteHD',id=600cb64a-ed8f-4db7-8dbf-d611e69d8adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7533923f4a4501bb9872bbfffaec8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:12:18Z,use_quota=True,user_id='6662576212c344d19b52a66b42d6cc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(738f5af0-3aa6-46c0-aaf5-6a7133d9021b),volume_type_id=738f5af0-3aa6-46c0-aaf5-6a7133d9021b)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4c4b5-2c3e-4c4b-993c-a87939ea61b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4c4b5-2c3e-4c4b-993c-a87939ea61b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37cece1-be71-4f32-b62b-bd03b3d35212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37cece1-be71-4f32-b62b-bd03b3d35212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600cb64a-ed8f-4db7-8dbf-d611e69d8adc', 'volume_name': 'volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb65dcb7-3d6c-44d3-b30c-a729f747f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb65dcb7-3d6c-44d3-b30c-a729f747f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a058c511-18ad-4307-b013-7fc71b5745f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:18 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Volume 600cb64a-ed8f-4db7-8dbf-d611e69d8adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc', 'volume_size': 1}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=57209e65-f139-419a-9a5d-c50a3dc64b02,created_at=2026-06-24T02:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78512669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=57209e65-f139-419a-9a5d-c50a3dc64b02,host='devstack@QuobyteHD#QuobyteHD',id=600cb64a-ed8f-4db7-8dbf-d611e69d8adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef7533923f4a4501bb9872bbfffaec8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:12:18Z,use_quota=True,user_id='6662576212c344d19b52a66b42d6cc25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(738f5af0-3aa6-46c0-aaf5-6a7133d9021b),volume_type_id=738f5af0-3aa6-46c0-aaf5-6a7133d9021b)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Creating volume 600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:12:18 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:12:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:18 devstack sudo[94316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc 1073741824
Jun 24 04:12:18 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:20 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc 1073741824" returned: 0 in 1.922s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:20 devstack sudo[94671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc
Jun 24 04:12:20 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:22 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" returned: 0 in 1.413s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] <== create_volume: return (3457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:12:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.462s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a058c511-18ad-4307-b013-7fc71b5745f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7543ca-db0a-48d8-b67b-df6ad8775b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Volume volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc (600cb64a-ed8f-4db7-8dbf-d611e69d8adc): created successfully
Jun 24 04:12:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7543ca-db0a-48d8-b67b-df6ad8775b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Flow 'volume_create_manager' (e275e8d9-8969-444c-8a56-387628a1437a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:12:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ede3013c-d0e4-472f-b2d1-3fb8d16996ff tempest-GroupsV314Test-218288902 None] Created volume successfully.
Jun 24 04:12:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:26 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Cloning volume 600cb64a-ed8f-4db7-8dbf-d611e69d8adc to volume 7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d
Jun 24 04:12:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Creating offline snapshot a340f76e-2c98-4356-b57b-12ce88833b4a of volume 600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:12:26 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp71mg3tzo/privsep.sock']
Jun 24 04:12:26 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp71mg3tzo/privsep.sock
Jun 24 04:12:26 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 24 04:12:27 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log: 
Jun 24 04:12:29 devstack cinder-volume[93468]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jun 24 04:12:30 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:30 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Spawned new privsep daemon via rootwrap
Jun 24 04:12:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Accepted privsep connection to /tmp/tmp71mg3tzo/privsep.sock {{(pid=93468) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jun 24 04:12:30 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jun 24 04:12:30 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jun 24 04:12:30 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jun 24 04:12:30 devstack cinder-volume[93468]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94794
Jun 24 04:12:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a7dd66-9397-4147-abf7-2c7ae746e56b]: (2,) {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:12:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[003daf7d-7316-4156-8cf4-457ec47a8e80]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:12:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:30 devstack sudo[94821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc
Jun 24 04:12:30 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:31 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" returned: 0 in 1.616s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:31 devstack sudo[94836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a 1G
Jun 24 04:12:31 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Flow 'volume_create_manager' (29fcd308-dcc7-4975-867a-9a8ae17a503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9d3246-e896-488f-9d86-01ddb2523eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9d3246-e896-488f-9d86-01ddb2523eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1795129724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b6f9bc-b567-4353-9358-e0fc3041c56e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad17b48b4184bcd9c294a3ec401c94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:12:33Z,use_quota=True,user_id='cd86ea94efa14c97824a86b24c04f1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346d045e-1ff1-4b6e-9ac9-0331f600a9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346d045e-1ff1-4b6e-9ac9-0331f600a9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9762058e-8da6-4185-a96d-fe9af3670d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9762058e-8da6-4185-a96d-fe9af3670d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b6f9bc-b567-4353-9358-e0fc3041c56e', 'volume_name': 'volume-72b6f9bc-b567-4353-9358-e0fc3041c56e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777c44ad-c5a5-4bbe-8a76-f64162e40268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777c44ad-c5a5-4bbe-8a76-f64162e40268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5a29c6-b73d-463a-b93b-342203c6b809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Volume 72b6f9bc-b567-4353-9358-e0fc3041c56e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b6f9bc-b567-4353-9358-e0fc3041c56e', 'volume_size': 1}
Jun 24 04:12:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:33 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a 1G" returned: 0 in 1.823s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:33 devstack sudo[94903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a
Jun 24 04:12:33 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:34 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a" returned: 0 in 1.134s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:34 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:12:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:34 devstack sudo[94922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a
Jun 24 04:12:34 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:36 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a" returned: 0 in 1.253s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:36 devstack sudo[94955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.info
Jun 24 04:12:36 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:37 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.info" returned: 0 in 1.559s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:37 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:12:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:37 devstack sudo[94981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.info
Jun 24 04:12:37 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:39 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.info" returned: 0 in 1.558s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Acquiring lock "cinder-quobyte-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Lock "cinder-quobyte-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] snapshot: a340f76e-2c98-4356-b57b-12ce88833b4a, volume: 7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe9436-c552-488b-be10-dc9949c1b899]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:12:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:39 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a
Jun 24 04:12:39 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:41 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a" returned: 0 in 1.973s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:12:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:12:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:12:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f66ee1-82ef-4d91-be35-10745d832b75]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:12:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:41 devstack sudo[94995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc
Jun 24 04:12:41 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:43 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" returned: 0 in 1.679s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:43 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:12:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:43 devstack sudo[95042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d
Jun 24 04:12:43 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:46 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:12:46 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:12:50 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" returned: 0 in 7.459s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:50 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5eb1a-812e-4d1d-ae28-8c534f6885d1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:12:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:50 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:12:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Flow 'volume_create_manager' (54ec714a-35e8-4950-b286-719d648b53d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:12:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3fd50b-1db4-4f8b-a212-8a20cc131a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:50 devstack sudo[95097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc
Jun 24 04:12:50 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3fd50b-1db4-4f8b-a212-8a20cc131a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-562623571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a59025b-07d7-405e-ab9d-023287b0271f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c546ad6d7f4fa280f30b7751cb7131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:12:51Z,use_quota=True,user_id='240c970aa91049f597077bae5dc20463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1033cf-b6ad-4883-98aa-538cc25446c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1033cf-b6ad-4883-98aa-538cc25446c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ded7056-e66c-44bc-8767-8f91922d1e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ded7056-e66c-44bc-8767-8f91922d1e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a59025b-07d7-405e-ab9d-023287b0271f', 'volume_name': 'volume-6a59025b-07d7-405e-ab9d-023287b0271f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d86a61a-5fe0-49ee-a2d5-e7e8db7ca9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d86a61a-5fe0-49ee-a2d5-e7e8db7ca9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3388a649-84cb-4fdc-a6f1-314beb017a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Volume 6a59025b-07d7-405e-ab9d-023287b0271f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a59025b-07d7-405e-ab9d-023287b0271f', 'volume_size': 1}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:51 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" returned: 0 in 1.211s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:12:51 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Converted 1024.00 MB image at 137.27 MB/s
Jun 24 04:12:51 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:12:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:51 devstack sudo[95102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d
Jun 24 04:12:51 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:52 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" returned: 0 in 0.677s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Lock "cinder-quobyte-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" released by "_copy_volume_from_snapshot" :: held 13.231s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:12:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Acquiring lock "cinder-quobyte-a340f76e-2c98-4356-b57b-12ce88833b4a" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:12:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Lock "cinder-quobyte-a340f76e-2c98-4356-b57b-12ce88833b4a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:12:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Deleting offline snapshot a340f76e-2c98-4356-b57b-12ce88833b4a of volume 600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:12:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] snapshot_file for this snap is: volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:12:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[656aa23b-d03c-4af5-9152-ceb8dd392b4b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:12:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:52 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a
Jun 24 04:12:52 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:53 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a" returned: 0 in 0.774s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:12:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4333337f-16c9-4a69-9aac-6e1add0b0cb0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:12:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:53 devstack sudo[95110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc
Jun 24 04:12:53 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:54 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" returned: 0 in 0.799s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:54 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a
Jun 24 04:12:54 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:55 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a" returned: 0 in 0.760s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:55 devstack sudo[95121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a
Jun 24 04:12:55 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:55 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc.a340f76e-2c98-4356-b57b-12ce88833b4a" returned: 0 in 0.708s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Lock "cinder-quobyte-a340f76e-2c98-4356-b57b-12ce88833b4a" released by "_delete_snapshot" :: held 3.149s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 29.740s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.045s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1795129724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b6f9bc-b567-4353-9358-e0fc3041c56e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad17b48b4184bcd9c294a3ec401c94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:12:33Z,use_quota=True,user_id='cd86ea94efa14c97824a86b24c04f1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Creating volume 72b6f9bc-b567-4353-9358-e0fc3041c56e {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:12:55 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:12:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:55 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e 1073741824
Jun 24 04:12:55 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c313edf4-cccc-489d-ab32-5dc6014a0844 tempest-GroupsV314Test-218288902 None] Create group from source-group-57209e65-f139-419a-9a5d-c50a3dc64b02 completed successfully.
Jun 24 04:12:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e 1073741824" returned: 0 in 0.941s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:56 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:56 devstack sudo[95129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e
Jun 24 04:12:56 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Acquiring lock "cinder-quobyte-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Lock "cinder-quobyte-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb6c05d-6fe0-4e29-bf67-40446768640c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:57 devstack sudo[95131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d
Jun 24 04:12:57 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:57 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e" returned: 0 in 0.705s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.498s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-562623571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a59025b-07d7-405e-ab9d-023287b0271f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c546ad6d7f4fa280f30b7751cb7131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:12:51Z,use_quota=True,user_id='240c970aa91049f597077bae5dc20463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Creating volume 6a59025b-07d7-405e-ab9d-023287b0271f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:12:57 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:57 devstack sudo[95134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f 1073741824
Jun 24 04:12:57 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5a29c6-b73d-463a-b93b-342203c6b809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b6f9bc-b567-4353-9358-e0fc3041c56e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1cfc9b2-7960-4338-aa90-7eeaca041991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Volume volume-72b6f9bc-b567-4353-9358-e0fc3041c56e (72b6f9bc-b567-4353-9358-e0fc3041c56e): created successfully
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1cfc9b2-7960-4338-aa90-7eeaca041991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Flow 'volume_create_manager' (29fcd308-dcc7-4975-867a-9a8ae17a503a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:12:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7029ee39-6937-4e77-beed-a350e5ac2ee1 tempest-ServerRescueNegativeTestJSON-2092590911 None] Created volume successfully.
Jun 24 04:12:58 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" returned: 0 in 0.990s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:58 devstack sudo[95143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d
Jun 24 04:12:58 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:58 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f 1073741824" returned: 0 in 1.107s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:58 devstack sudo[95145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f
Jun 24 04:12:58 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:12:59 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" returned: 0 in 0.875s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Lock "cinder-quobyte-7deae6b3-dd3c-47c8-bec3-2a2c542a5a4d" released by "delete_volume" :: held 1.940s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Created reservations ['1cb38bef-3c07-47b2-ba39-1e8f5482365d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:12:59 devstack cinder-volume[93468]: WARNING cinder.quota [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-255940994 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-255940994, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:12:59 devstack cinder-volume[93468]: WARNING cinder.quota [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-255940994 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-255940994, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Created reservations ['95f41db8-d3b6-4357-aecc-e09622377e7e', '33ad5bb2-bc8b-4f62-9afe-3b9326b6c92c', '1c87b11b-c75c-4d19-ac4d-324a9268c4fb', 'fc24bdb9-a265-4ad7-b9d1-a3f380950cc6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:12:59 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f" returned: 0 in 0.769s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3388a649-84cb-4fdc-a6f1-314beb017a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a59025b-07d7-405e-ab9d-023287b0271f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3751e17e-747a-43cb-a55f-8432e7adb4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:12:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Volume volume-6a59025b-07d7-405e-ab9d-023287b0271f (6a59025b-07d7-405e-ab9d-023287b0271f): created successfully
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3751e17e-747a-43cb-a55f-8432e7adb4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Flow 'volume_create_manager' (54ec714a-35e8-4950-b286-719d648b53d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:12:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1e9021cc-8ed1-4845-a885-6793e0f9cb4e tempest-ServersNegativeTestJSON-608037068 None] Created volume successfully.
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:12:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:12:59 devstack sudo[95151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:12:59 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Acquiring lock "cinder-quobyte-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Lock "cinder-quobyte-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" acquired by "delete_volume" :: waited 0.050s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b566b679-d271-43b8-ad20-9bafe68bbec5]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:00 devstack sudo[95153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc
Jun 24 04:13:00 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:00 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.912s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:00 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a3d4e77d-7177-4ffe-a195-479747771781 tempest-GroupsV314Test-218288902 None] Delete group completed successfully.
Jun 24 04:13:01 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" returned: 0 in 1.020s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:01 devstack sudo[95159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc
Jun 24 04:13:01 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:01 devstack sudo[95161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:13:01 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:02 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" returned: 0 in 1.076s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Lock "cinder-quobyte-600cb64a-ed8f-4db7-8dbf-d611e69d8adc" released by "delete_volume" :: held 2.201s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Created reservations ['f987a32c-9e3f-40c4-b093-460806bac986'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Flow 'volume_create_manager' (2b3ce394-c52c-4ff9-85e5-5a15cf2464de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e670a2-574d-473a-9964-409514b4d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e670a2-574d-473a-9964-409514b4d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1937978915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f69d461-b9b6-4524-9663-2c46f589bc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c546ad6d7f4fa280f30b7751cb7131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:02Z,use_quota=True,user_id='240c970aa91049f597077bae5dc20463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06240d44-90ae-41b1-9260-6279ca6edaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06240d44-90ae-41b1-9260-6279ca6edaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c0e27b-3cd9-4cce-91af-29c38f69450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c0e27b-3cd9-4cce-91af-29c38f69450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f69d461-b9b6-4524-9663-2c46f589bc99', 'volume_name': 'volume-7f69d461-b9b6-4524-9663-2c46f589bc99', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ee7bf0-e8e2-400b-83f6-b84d7510c5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:02 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ee7bf0-e8e2-400b-83f6-b84d7510c5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a1fa2b-cb9d-4052-bc20-30e31ad7888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Volume 7f69d461-b9b6-4524-9663-2c46f589bc99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f69d461-b9b6-4524-9663-2c46f589bc99', 'volume_size': 1}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1937978915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f69d461-b9b6-4524-9663-2c46f589bc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c546ad6d7f4fa280f30b7751cb7131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:02Z,use_quota=True,user_id='240c970aa91049f597077bae5dc20463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Creating volume 7f69d461-b9b6-4524-9663-2c46f589bc99 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:13:02 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.867s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:02 devstack sudo[95165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99 1073741824
Jun 24 04:13:02 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 8 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Created reservations ['490cce5a-738c-4a48-b42f-739ac19b3e64', '0394e423-f1f7-4dfe-bed0-4bdef8b896f5', '620cac2a-43ab-43cb-9167-a4739af68a57', 'e3a7d888-62c2-4b13-a81b-926b9d98e64e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:03 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:13:03 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:04 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.069s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:04 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-99b259ca-70e8-4b5b-9d50-a8957aa47b96 tempest-GroupsV314Test-218288902 None] Delete group completed successfully.
Jun 24 04:13:04 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99 1073741824" returned: 0 in 1.630s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:04 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99
Jun 24 04:13:04 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:05 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99" returned: 0 in 0.896s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:13:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a1fa2b-cb9d-4052-bc20-30e31ad7888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f69d461-b9b6-4524-9663-2c46f589bc99', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60378c84-cc55-4a42-b97d-3e75beb4d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Volume volume-7f69d461-b9b6-4524-9663-2c46f589bc99 (7f69d461-b9b6-4524-9663-2c46f589bc99): created successfully
Jun 24 04:13:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60378c84-cc55-4a42-b97d-3e75beb4d717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Flow 'volume_create_manager' (2b3ce394-c52c-4ff9-85e5-5a15cf2464de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a9c38f8e-cedb-4987-a8a5-42173e1da5d7 tempest-ServersNegativeTestJSON-608037068 None] Created volume successfully.
Jun 24 04:13:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "cinder-7f69d461-b9b6-4524-9663-2c46f589bc99-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Lock "cinder-7f69d461-b9b6-4524-9663-2c46f589bc99-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "cinder-quobyte-7f69d461-b9b6-4524-9663-2c46f589bc99" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Lock "cinder-quobyte-7f69d461-b9b6-4524-9663-2c46f589bc99" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c62725-653d-4f9f-9620-7c197fc44335]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:07 devstack sudo[95251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99
Jun 24 04:13:07 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:08 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99" returned: 0 in 1.001s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:08 devstack sudo[95268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99
Jun 24 04:13:08 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:10 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f69d461-b9b6-4524-9663-2c46f589bc99" returned: 0 in 1.226s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Lock "cinder-quobyte-7f69d461-b9b6-4524-9663-2c46f589bc99" released by "delete_volume" :: held 2.333s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:10 devstack cinder-volume[93468]: WARNING cinder.quota [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:13:10 devstack cinder-volume[93468]: WARNING cinder.quota [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Created reservations ['abcd46f4-d95c-4ec5-bfeb-b2844f13b059', 'bda4b733-e0fa-45be-94d8-71b439c468c2', '4ad8132a-606d-42e9-94ae-a4d024068e4c', '21c50b09-d295-47e8-8132-b14314af9769'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:10 devstack sudo[95317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:13:10 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "cinder-6a59025b-07d7-405e-ab9d-023287b0271f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Lock "cinder-6a59025b-07d7-405e-ab9d-023287b0271f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "cinder-quobyte-6a59025b-07d7-405e-ab9d-023287b0271f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Lock "cinder-quobyte-6a59025b-07d7-405e-ab9d-023287b0271f" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[957dfbf6-f70d-4f92-b948-f76a175053db]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:11 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.282s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Deleted volume successfully.
Jun 24 04:13:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eca2355f-af29-4f30-a151-e5b8dd6d2c28 tempest-ServersNegativeTestJSON-608037068 None] Lock "cinder-7f69d461-b9b6-4524-9663-2c46f589bc99-delete_volume" released by "delete_volume" :: held 4.003s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:11 devstack sudo[95322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f
Jun 24 04:13:11 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:12 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f" returned: 0 in 1.289s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:12 devstack sudo[95329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f
Jun 24 04:13:12 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:14 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6a59025b-07d7-405e-ab9d-023287b0271f" returned: 0 in 1.502s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Lock "cinder-quobyte-6a59025b-07d7-405e-ab9d-023287b0271f" released by "delete_volume" :: held 2.872s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Created reservations ['68554149-d970-4f87-9262-c598249c596e', '239c40eb-240c-44ec-baa9-fb82e5195942', 'ed9bd54f-3fe5-46b5-9b3e-cc0acb4ca39f', 'e4b31c9e-273b-49ff-97ff-14a264ca4bec'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:14 devstack sudo[95333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:13:14 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:16 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.541s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:16 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Deleted volume successfully.
Jun 24 04:13:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a252ad19-e875-43e0-8f10-54d2bc95415d tempest-ServersNegativeTestJSON-608037068 None] Lock "cinder-6a59025b-07d7-405e-ab9d-023287b0271f-delete_volume" released by "delete_volume" :: held 4.809s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Acquiring lock "cinder-72b6f9bc-b567-4353-9358-e0fc3041c56e-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "cinder-72b6f9bc-b567-4353-9358-e0fc3041c56e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Acquiring lock "cinder-quobyte-72b6f9bc-b567-4353-9358-e0fc3041c56e" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "cinder-quobyte-72b6f9bc-b567-4353-9358-e0fc3041c56e" acquired by "delete_volume" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[09549881-afc6-468f-95ac-2fe6fa107a7a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:23 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e
Jun 24 04:13:23 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:25 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e" returned: 0 in 1.682s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:25 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e
Jun 24 04:13:25 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:26 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-72b6f9bc-b567-4353-9358-e0fc3041c56e" returned: 0 in 1.207s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "cinder-quobyte-72b6f9bc-b567-4353-9358-e0fc3041c56e" released by "delete_volume" :: held 2.963s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Created reservations ['ca1dd73f-e013-450d-949c-a764f05753ba', '0f97521b-89d3-47ff-9b11-57de9477fdf3', '2d8b733a-2b56-4d63-b314-989a7436e888', 'a2a7e360-490f-4978-8cb4-da13660fc92e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:26 devstack sudo[95538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:13:26 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:27 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.079s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:27 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Deleted volume successfully.
Jun 24 04:13:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bcce06ba-2990-464c-a4a8-e08936daa07f tempest-ServerRescueNegativeTestJSON-2092590911 None] Lock "cinder-72b6f9bc-b567-4353-9358-e0fc3041c56e-delete_volume" released by "delete_volume" :: held 4.457s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:36 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=40,cinder:UPDATE=65,cinder:INSERT=13,cinder:DELETE=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:13:37 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=50,cinder:SELECT=37,cinder:INSERT=12,cinder:DELETE=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Flow 'volume_create_manager' (4bce38e4-f964-4ca9-a617-3a4d160bea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ca43df-a3b4-4ed4-bb32-d7aab516e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ca43df-a3b4-4ed4-bb32-d7aab516e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1568377780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f3c157-ccf8-4c51-9d68-137b00baddae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35497fbd6149e1bb2458b2fe489760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:41Z,use_quota=True,user_id='0244b27bc5d54df68a87cbccf64828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b51e428-52f8-4f50-8bdb-9395145dcec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b51e428-52f8-4f50-8bdb-9395145dcec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d3e6ed-3c07-4e25-bac2-594c0eed34c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d3e6ed-3c07-4e25-bac2-594c0eed34c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f3c157-ccf8-4c51-9d68-137b00baddae', 'volume_name': 'volume-49f3c157-ccf8-4c51-9d68-137b00baddae', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a176b5f3-b879-4fb7-a493-9a8fe66fe5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a176b5f3-b879-4fb7-a493-9a8fe66fe5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca78d32-067d-4eb6-95c1-ca5df48e0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Volume 49f3c157-ccf8-4c51-9d68-137b00baddae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f3c157-ccf8-4c51-9d68-137b00baddae', 'volume_size': 1}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1568377780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f3c157-ccf8-4c51-9d68-137b00baddae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35497fbd6149e1bb2458b2fe489760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:41Z,use_quota=True,user_id='0244b27bc5d54df68a87cbccf64828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Creating volume 49f3c157-ccf8-4c51-9d68-137b00baddae {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:13:40 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:13:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:40 devstack sudo[95678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae 1073741824
Jun 24 04:13:40 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:41 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae 1073741824" returned: 0 in 0.999s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:41 devstack sudo[95685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae
Jun 24 04:13:41 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:42 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae" returned: 0 in 0.856s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:13:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca78d32-067d-4eb6-95c1-ca5df48e0da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f3c157-ccf8-4c51-9d68-137b00baddae', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b811de-ee75-4616-b4b7-abf7f4dc500b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Volume volume-49f3c157-ccf8-4c51-9d68-137b00baddae (49f3c157-ccf8-4c51-9d68-137b00baddae): created successfully
Jun 24 04:13:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b811de-ee75-4616-b4b7-abf7f4dc500b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Flow 'volume_create_manager' (4bce38e4-f964-4ca9-a617-3a4d160bea9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5e39ef56-73ab-4414-9993-8797904580dc tempest-VolumeQuotasAdminTestJSON-1526752982 None] Created volume successfully.
Jun 24 04:13:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Acquiring lock "cinder-49f3c157-ccf8-4c51-9d68-137b00baddae-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "cinder-49f3c157-ccf8-4c51-9d68-137b00baddae-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Acquiring lock "cinder-quobyte-49f3c157-ccf8-4c51-9d68-137b00baddae" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "cinder-quobyte-49f3c157-ccf8-4c51-9d68-137b00baddae" acquired by "delete_volume" :: waited 0.047s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7357667-16de-4bc8-9a1d-fb5bcb91783a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:44 devstack sudo[95696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae
Jun 24 04:13:44 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:45 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae" returned: 0 in 0.994s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:45 devstack sudo[95703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae
Jun 24 04:13:45 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:46 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3c157-ccf8-4c51-9d68-137b00baddae" returned: 0 in 0.855s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "cinder-quobyte-49f3c157-ccf8-4c51-9d68-137b00baddae" released by "delete_volume" :: held 1.916s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Created reservations ['54b1429a-06bb-47e8-8286-d45f0f5251fc', 'a9106707-f2cf-402b-b56a-fa4208378178', 'f6d4bf95-dbd9-491a-8388-b41d534435aa', '771b6a05-0ac2-4ac7-974a-6b5f36a592a5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:46 devstack sudo[95706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:13:46 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:47 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.871s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Flow 'volume_create_manager' (72dcb344-398d-4259-8d2d-fbd9c958a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942589ed-14f0-4587-84f4-908c5c788479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Deleted volume successfully.
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942589ed-14f0-4587-84f4-908c5c788479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1132471500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae19462-ac7b-4950-bb09-b2a2e47e0a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35497fbd6149e1bb2458b2fe489760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:47Z,use_quota=True,user_id='0244b27bc5d54df68a87cbccf64828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f83a184-a787-412b-83cd-48b7c8f26e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f83a184-a787-412b-83cd-48b7c8f26e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336eac7b-01b5-44aa-b259-d57ecba52b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336eac7b-01b5-44aa-b259-d57ecba52b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae19462-ac7b-4950-bb09-b2a2e47e0a5c', 'volume_name': 'volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e330d2-c0d7-484f-9bda-d309c340c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e330d2-c0d7-484f-9bda-d309c340c60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c2311f-82e4-45e0-ac67-52f823ce4d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Volume 0ae19462-ac7b-4950-bb09-b2a2e47e0a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c', 'volume_size': 1}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1132471500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae19462-ac7b-4950-bb09-b2a2e47e0a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35497fbd6149e1bb2458b2fe489760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:47Z,use_quota=True,user_id='0244b27bc5d54df68a87cbccf64828eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Creating volume 0ae19462-ac7b-4950-bb09-b2a2e47e0a5c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:13:47 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a55f687-241e-4957-9dfa-b97892cb613f tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "cinder-49f3c157-ccf8-4c51-9d68-137b00baddae-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:47 devstack sudo[95709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c 1073741824
Jun 24 04:13:47 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:48 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c 1073741824" returned: 0 in 1.028s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:48 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c
Jun 24 04:13:48 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:49 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c" returned: 0 in 0.770s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:13:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c2311f-82e4-45e0-ac67-52f823ce4d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97637c0-4b59-417c-aba0-3e62dbc42b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Volume volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c (0ae19462-ac7b-4950-bb09-b2a2e47e0a5c): created successfully
Jun 24 04:13:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97637c0-4b59-417c-aba0-3e62dbc42b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Flow 'volume_create_manager' (72dcb344-398d-4259-8d2d-fbd9c958a79e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-85865552-11a0-43b7-b65b-38901e1a60c0 tempest-VolumeQuotasAdminTestJSON-1526752982 None] Created volume successfully.
Jun 24 04:13:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-bd078048-7d9f-4a8a-8d51-8289139ea77b tempest-VolumeQuotasAdminTestJSON-404826188 None] Transfer volume completed successfully.
Jun 24 04:13:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Acquiring lock "cinder-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Lock "cinder-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Acquiring lock "cinder-quobyte-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:13:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Lock "cinder-quobyte-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:13:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f188ff7a-a635-4b3b-b7f1-365d1d5b2162]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:13:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:53 devstack sudo[95738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c
Jun 24 04:13:53 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:54 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c" returned: 0 in 0.995s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:54 devstack sudo[95749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c
Jun 24 04:13:54 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:54 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c" returned: 0 in 0.763s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Lock "cinder-quobyte-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c" released by "delete_volume" :: held 1.821s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Created reservations ['1d0f9a41-5c87-4c77-ac6a-1ea8c5ed1706', 'dd80d61b-cebc-4d81-9567-0a6fce0a1dd0', 'b85d3282-374c-4fc2-9b5b-e96e5df14b11', 'f99bb152-9148-4c81-b1e4-8463b01bc795'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:55 devstack sudo[95752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:13:55 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:13:56 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root
Jun 24 04:13:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.034s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:13:56 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:13:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Deleted volume successfully.
Jun 24 04:13:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b9e4d8c3-09c7-4a33-bc82-f157cfdf2c17 tempest-VolumeQuotasAdminTestJSON-721529152 None] Lock "cinder-0ae19462-ac7b-4950-bb09-b2a2e47e0a5c-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Flow 'volume_create_manager' (6efb7f77-b3c4-4cb0-ace5-e8d494cc1b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807c5ecb-3b0f-448a-86f0-36fe9a68523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807c5ecb-3b0f-448a-86f0-36fe9a68523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1387902685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832b81bd-faf7-4a1b-8053-8f0ca0b1e926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf1658c62a4268bd89e8f25679816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:59Z,use_quota=True,user_id='c94f7828d1a643f28a087764be051e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae813468-a19a-4e8b-8526-df0713b6749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae813468-a19a-4e8b-8526-df0713b6749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fcfecf-0fda-4eb3-a95f-a082c02182d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fcfecf-0fda-4eb3-a95f-a082c02182d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832b81bd-faf7-4a1b-8053-8f0ca0b1e926', 'volume_name': 'volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a2cd28-9540-467b-b70d-5d58ea6b39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a2cd28-9540-467b-b70d-5d58ea6b39b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f74e3a-c625-4a2e-8be5-431b59968f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:13:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Volume 832b81bd-faf7-4a1b-8053-8f0ca0b1e926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926', 'volume_size': 1}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1387902685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832b81bd-faf7-4a1b-8053-8f0ca0b1e926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8bf1658c62a4268bd89e8f25679816c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:13:59Z,use_quota=True,user_id='c94f7828d1a643f28a087764be051e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Creating volume 832b81bd-faf7-4a1b-8053-8f0ca0b1e926 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:13:59 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:13:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:13:59 devstack sudo[95771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 1073741824
Jun 24 04:13:59 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:00 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 1073741824" returned: 0 in 1.377s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:00 devstack sudo[95848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926
Jun 24 04:14:00 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:01 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" returned: 0 in 1.004s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] <== create_volume: return (2507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.510s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f74e3a-c625-4a2e-8be5-431b59968f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0e97c0-202e-4d4a-9cfe-e28977504cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Volume volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 (832b81bd-faf7-4a1b-8053-8f0ca0b1e926): created successfully
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0e97c0-202e-4d4a-9cfe-e28977504cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Flow 'volume_create_manager' (6efb7f77-b3c4-4cb0-ace5-e8d494cc1b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-b57c3cea-a1f3-4ba0-a972-0f05662cfc35 req-d46130d0-9dab-4b42-b5fc-f813270cc661 tempest-VolumesSnapshotsTestJSON-894470701 None] Created volume successfully.
Jun 24 04:14:01 devstack sudo[95855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:14:01 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:02 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.100s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Creating offline snapshot fcf31395-286e-4855-8284-c0ae5d88ed92 of volume 832b81bd-faf7-4a1b-8053-8f0ca0b1e926 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:14:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83ddbc-e69b-4c91-91f6-95b28b0fb321]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:03 devstack sudo[95860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926
Jun 24 04:14:03 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" returned: 0 in 1.440s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:04 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:04 devstack sudo[95874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 1G
Jun 24 04:14:04 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:06 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 1G" returned: 0 in 1.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:06 devstack sudo[95894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92
Jun 24 04:14:06 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Flow 'volume_create_manager' (cc5637af-8fe2-40f3-9269-989602e0d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd98db7-4b7f-44cb-a85a-1f72cad335df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd98db7-4b7f-44cb-a85a-1f72cad335df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1918475541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f241ae-7fda-4e1a-9427-2a8da29b201f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40ee79b42fb4ee79c34db2abb097729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:06Z,use_quota=True,user_id='893525bdb29748ab94bf4a8341407546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(629a9c27-6667-4d03-a104-26e059e96da9),volume_type_id=629a9c27-6667-4d03-a104-26e059e96da9)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cdbed2-d531-4bb6-8414-7d2e509b8820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cdbed2-d531-4bb6-8414-7d2e509b8820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134508e9-a98c-40a0-a6f0-edea5ee807a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134508e9-a98c-40a0-a6f0-edea5ee807a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f241ae-7fda-4e1a-9427-2a8da29b201f', 'volume_name': 'volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4b8f84-d426-477b-ae37-f0ce42ab9d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4b8f84-d426-477b-ae37-f0ce42ab9d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ab0d48-235f-4542-b76b-c4cf1161bf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Volume a8f241ae-7fda-4e1a-9427-2a8da29b201f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f', 'volume_size': 1}
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:06 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92" returned: 0 in 0.742s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:06 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 is being set with open permissions: ugo+rw
Jun 24 04:14:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:06 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92
Jun 24 04:14:06 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:07 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92" returned: 0 in 0.705s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:07 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.info
Jun 24 04:14:07 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:07 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Flow 'volume_create_manager' (b1b78661-4dfc-4c1a-9006-7e4371305498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefd0e0a-164e-426a-84b4-a65e1483cfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefd0e0a-164e-426a-84b4-a65e1483cfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1541799257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5097aac1-e16f-4b8c-9706-271b60ab087d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a946925b346b43fa9b569fe78fa36b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:08Z,use_quota=True,user_id='0aad4e804c0b42118cc009a9c6f1c966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0823f9-9d65-4fa3-974e-19eca4e3fde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0823f9-9d65-4fa3-974e-19eca4e3fde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb5599d-9132-4bc3-9694-0e8df048d056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb5599d-9132-4bc3-9694-0e8df048d056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5097aac1-e16f-4b8c-9706-271b60ab087d', 'volume_name': 'volume-5097aac1-e16f-4b8c-9706-271b60ab087d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69262550-5c10-4eff-963e-810a81d0867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69262550-5c10-4eff-963e-810a81d0867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6148f36a-1139-430a-aab5-41b612dde149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Volume 5097aac1-e16f-4b8c-9706-271b60ab087d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5097aac1-e16f-4b8c-9706-271b60ab087d', 'volume_size': 1}
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:08 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.info" returned: 0 in 1.058s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:08 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.info is being set with open permissions: ugo+rw
Jun 24 04:14:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:08 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.info
Jun 24 04:14:08 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:09 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.info" returned: 0 in 0.743s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.455s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.060s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1918475541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f241ae-7fda-4e1a-9427-2a8da29b201f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40ee79b42fb4ee79c34db2abb097729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:06Z,use_quota=True,user_id='893525bdb29748ab94bf4a8341407546',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(629a9c27-6667-4d03-a104-26e059e96da9),volume_type_id=629a9c27-6667-4d03-a104-26e059e96da9)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Creating volume a8f241ae-7fda-4e1a-9427-2a8da29b201f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:14:09 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:14:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:09 devstack sudo[95909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f 1073741824
Jun 24 04:14:09 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-e5574006-296a-4206-84af-c2a420af1af9 req-ecb064e8-4bdf-4583-921e-73b72a06068e tempest-VolumesSnapshotsTestJSON-894470701 None] Create snapshot completed successfully
Jun 24 04:14:10 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f 1073741824" returned: 0 in 0.853s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:10 devstack sudo[95918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f
Jun 24 04:14:10 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "cinder-fcf31395-286e-4855-8284-c0ae5d88ed92-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-fcf31395-286e-4855-8284-c0ae5d88ed92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "cinder-quobyte-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-quobyte-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "cinder-quobyte-fcf31395-286e-4855-8284-c0ae5d88ed92" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-quobyte-fcf31395-286e-4855-8284-c0ae5d88ed92" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Deleting offline snapshot fcf31395-286e-4855-8284-c0ae5d88ed92 of volume 832b81bd-faf7-4a1b-8053-8f0ca0b1e926 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] snapshot_file for this snap is: volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67a19d-cce4-41f0-b389-906def87fe6b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:10 devstack sudo[95921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92
Jun 24 04:14:10 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:11 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f" returned: 0 in 0.788s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.954s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1541799257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5097aac1-e16f-4b8c-9706-271b60ab087d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a946925b346b43fa9b569fe78fa36b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:08Z,use_quota=True,user_id='0aad4e804c0b42118cc009a9c6f1c966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Creating volume 5097aac1-e16f-4b8c-9706-271b60ab087d {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:14:11 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ab0d48-235f-4542-b76b-c4cf1161bf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:11 devstack sudo[95924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d 1073741824
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d60fb0-8c76-4df5-b469-0801f9a2d140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:11 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:11 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Volume volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f (a8f241ae-7fda-4e1a-9427-2a8da29b201f): created successfully
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d60fb0-8c76-4df5-b469-0801f9a2d140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Flow 'volume_create_manager' (cc5637af-8fe2-40f3-9269-989602e0d41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9e88cea5-558f-41a4-b6ac-80f08fb5c35e tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Created volume successfully.
Jun 24 04:14:11 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92" returned: 0 in 0.855s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[45851ee1-4444-473a-be27-eef6c7d91464]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:11 devstack sudo[95936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926
Jun 24 04:14:11 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:12 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d 1073741824" returned: 0 in 1.511s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:12 devstack sudo[95987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:14:12 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:12 devstack sudo[95992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d
Jun 24 04:14:12 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:13 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" returned: 0 in 1.692s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:13 devstack sudo[96011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92
Jun 24 04:14:13 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Acquiring lock "cinder-a8f241ae-7fda-4e1a-9427-2a8da29b201f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "cinder-a8f241ae-7fda-4e1a-9427-2a8da29b201f-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:14 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d" returned: 0 in 1.919s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] <== create_volume: return (3685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.689s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6148f36a-1139-430a-aab5-41b612dde149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5097aac1-e16f-4b8c-9706-271b60ab087d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a3d572-2436-4a2a-8bb7-60ba74acccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Acquiring lock "cinder-quobyte-a8f241ae-7fda-4e1a-9427-2a8da29b201f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Volume volume-5097aac1-e16f-4b8c-9706-271b60ab087d (5097aac1-e16f-4b8c-9706-271b60ab087d): created successfully
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a3d572-2436-4a2a-8bb7-60ba74acccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Flow 'volume_create_manager' (b1b78661-4dfc-4c1a-9006-7e4371305498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:14 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 2.147s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "cinder-quobyte-a8f241ae-7fda-4e1a-9427-2a8da29b201f" acquired by "delete_volume" :: waited 0.066s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-08156425-b3a0-4765-83d9-25170e38fe39 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Retype volume completed successfully.
Jun 24 04:14:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1d742ec2-8606-470c-bd83-3b3679039ee4 tempest-VolumesAdminNegativeTest-682723217 None] Created volume successfully.
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4bf112-4fae-47a3-a428-d053b2632bcb]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:15 devstack sudo[96031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f
Jun 24 04:14:15 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:15 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92" returned: 0 in 2.096s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:15 devstack sudo[96037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92
Jun 24 04:14:15 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:16 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f" returned: 0 in 1.456s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:16 devstack sudo[96042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f
Jun 24 04:14:16 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:16 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926.fcf31395-286e-4855-8284-c0ae5d88ed92" returned: 0 in 1.435s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Acquiring lock "cinder-5097aac1-e16f-4b8c-9706-271b60ab087d-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-quobyte-fcf31395-286e-4855-8284-c0ae5d88ed92" released by "_delete_snapshot" :: held 6.294s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-quobyte-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" released by "delete_snapshot" :: held 6.350s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Lock "cinder-5097aac1-e16f-4b8c-9706-271b60ab087d-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Acquiring lock "cinder-quobyte-5097aac1-e16f-4b8c-9706-271b60ab087d" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:17 devstack cinder-volume[93468]: WARNING cinder.quota [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Lock "cinder-quobyte-5097aac1-e16f-4b8c-9706-271b60ab087d" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.quota [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Created reservations ['971c04da-22f7-4966-98f7-65d17f2fdbd4', 'd409ad22-cf7d-4e93-a313-7ddd4d327dd0', '4db19771-4ac8-43c5-b463-b9acc1bdf7ee', 'ae56104e-ea02-4920-8488-1621f57b8395'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d15df3e-357e-4714-8669-8e9c550326f6]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Delete snapshot completed successfully.
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-e308ceb9-ff8d-4eef-b7f4-b1c7358fc361 req-d4dbf516-b0de-447d-96ab-3a137b4c9799 tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-fcf31395-286e-4855-8284-c0ae5d88ed92-delete_snapshot" released by "delete_snapshot" :: held 6.760s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:17 devstack sudo[96074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d
Jun 24 04:14:17 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "cinder-832b81bd-faf7-4a1b-8053-8f0ca0b1e926-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-832b81bd-faf7-4a1b-8053-8f0ca0b1e926-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "cinder-quobyte-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-quobyte-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" acquired by "delete_volume" :: waited 0.050s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:17 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a8f241ae-7fda-4e1a-9427-2a8da29b201f" returned: 0 in 1.429s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "cinder-quobyte-a8f241ae-7fda-4e1a-9427-2a8da29b201f" released by "delete_volume" :: held 2.956s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f80cbe-2dc9-40ad-84e9-f6d0c9c270ea]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:17 devstack cinder-volume[93468]: WARNING cinder.quota [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:14:17 devstack cinder-volume[93468]: WARNING cinder.quota [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:14:17 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Created reservations ['b6aa9dc9-5720-40b5-8921-550bd3eb3ad1', '2d588a37-d493-496b-93a2-0d9313695d25', '9869cbc0-0cae-44f8-b3da-6c18e4874762', 'b8033d57-c25f-425f-84e6-7d97a7fbfd24'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:14:18 devstack sudo[96077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926
Jun 24 04:14:18 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:18 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:14:18 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:18 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d" returned: 0 in 1.429s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:18 devstack sudo[96084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d
Jun 24 04:14:18 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:19 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5097aac1-e16f-4b8c-9706-271b60ab087d" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Lock "cinder-quobyte-5097aac1-e16f-4b8c-9706-271b60ab087d" released by "delete_volume" :: held 2.381s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Created reservations ['4f7b666e-7334-40ed-93d8-ee74b7cf08c1', '82d99ad8-ac21-44fe-b4ab-3016fc2d4d9c', 'a8d16fd1-f9cf-41fc-938b-5b39927aac79', 'b04762bc-e14a-48f9-b286-9108c12b00b4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:19 devstack sudo[96091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:14:19 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:19 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.530s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:19 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Deleted volume successfully.
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" returned: 0 in 1.906s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c9c2f85-0e96-4cbd-b298-3718606393f8 tempest-VolumeRetypeWithoutMigrationTest-1784041296 None] Lock "cinder-a8f241ae-7fda-4e1a-9427-2a8da29b201f-delete_volume" released by "delete_volume" :: held 5.116s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:19 devstack sudo[96093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926
Jun 24 04:14:19 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.928s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:20 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Deleted volume successfully.
Jun 24 04:14:20 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7e6ab83a-c919-4d15-8c1a-387c01f0844f tempest-VolumesAdminNegativeTest-682723217 None] Lock "cinder-5097aac1-e16f-4b8c-9706-271b60ab087d-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:21 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" returned: 0 in 1.327s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-quobyte-832b81bd-faf7-4a1b-8053-8f0ca0b1e926" released by "delete_volume" :: held 3.364s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG cinder.quota [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Created reservations ['990162c0-62c4-4afd-8baa-f9c49ffe7477', 'd5ae9c6c-9cd3-4833-a684-06bd1f14e941', 'f1caee5c-6482-4f39-a1eb-72d15c754791', 'b45730d9-e5a4-456b-9bec-5454da7e5e6a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:21 devstack sudo[96099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:14:21 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:22 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.624s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:22 devstack cinder-volume[93468]: DEBUG cinder.manager [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Deleted volume successfully.
Jun 24 04:14:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-937c859e-d38d-4ac4-8b9b-c5bf0fb03fe3 req-8d5e36ce-fb46-44a6-bc73-e4468936762d tempest-VolumesSnapshotsTestJSON-894470701 None] Lock "cinder-832b81bd-faf7-4a1b-8053-8f0ca0b1e926-delete_volume" released by "delete_volume" :: held 5.400s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Flow 'volume_create_manager' (47b9bb51-fcc4-46af-9931-eb5e6e4b6cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeef3f6-c3bf-473d-afdf-2117424ce0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeef3f6-c3bf-473d-afdf-2117424ce0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-787377751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f3873a-248e-4dde-80b5-21430cba8369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125cb2551d9f4c7eaf63f70058945fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:28Z,use_quota=True,user_id='2d8052d41f6346edac2ef73c9626bec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdfbbaf-0529-4ac8-9f5d-79c4a8522b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdfbbaf-0529-4ac8-9f5d-79c4a8522b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c3ffef-6c6f-489b-a079-49d0c612029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c3ffef-6c6f-489b-a079-49d0c612029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f3873a-248e-4dde-80b5-21430cba8369', 'volume_name': 'volume-49f3873a-248e-4dde-80b5-21430cba8369', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514c606d-5795-49a1-bc93-9dd4a8b0520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514c606d-5795-49a1-bc93-9dd4a8b0520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59f0fb0-13d2-4ef7-8c6b-22cf6a45545e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Volume 49f3873a-248e-4dde-80b5-21430cba8369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f3873a-248e-4dde-80b5-21430cba8369', 'volume_size': 1}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-787377751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f3873a-248e-4dde-80b5-21430cba8369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125cb2551d9f4c7eaf63f70058945fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:28Z,use_quota=True,user_id='2d8052d41f6346edac2ef73c9626bec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Creating volume 49f3873a-248e-4dde-80b5-21430cba8369 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:14:28 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:14:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:28 devstack sudo[96186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369 1073741824
Jun 24 04:14:28 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:29 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369 1073741824" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:29 devstack sudo[96192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369
Jun 24 04:14:29 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:29 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369" returned: 0 in 0.650s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59f0fb0-13d2-4ef7-8c6b-22cf6a45545e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f3873a-248e-4dde-80b5-21430cba8369', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a22952-6777-469d-85c5-c474f92bba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Volume volume-49f3873a-248e-4dde-80b5-21430cba8369 (49f3873a-248e-4dde-80b5-21430cba8369): created successfully
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a22952-6777-469d-85c5-c474f92bba76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Flow 'volume_create_manager' (47b9bb51-fcc4-46af-9931-eb5e6e4b6cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e47813f0-524a-420b-bada-f201f6c172b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Created volume successfully.
Jun 24 04:14:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Creating offline snapshot d4290ba8-d859-4a88-b866-96926fe67ffa of volume 49f3873a-248e-4dde-80b5-21430cba8369 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:14:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[12189b9d-0856-4d40-8846-dc6ad5f855a3]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:30 devstack sudo[96196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369
Jun 24 04:14:30 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:31 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369" returned: 0 in 0.812s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:31 devstack sudo[96201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa 1G
Jun 24 04:14:31 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:32 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa 1G" returned: 0 in 0.906s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f3873a-248e-4dde-80b5-21430cba8369 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:32 devstack sudo[96208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f3873a-248e-4dde-80b5-21430cba8369 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa
Jun 24 04:14:32 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:33 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f3873a-248e-4dde-80b5-21430cba8369 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa" returned: 0 in 0.947s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:33 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa is being set with open permissions: ugo+rw
Jun 24 04:14:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:33 devstack sudo[96215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa
Jun 24 04:14:33 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:33 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa" returned: 0 in 0.743s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:34 devstack sudo[96220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.info
Jun 24 04:14:34 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.info" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:34 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.info is being set with open permissions: ugo+rw
Jun 24 04:14:34 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:34 devstack sudo[96231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.info
Jun 24 04:14:34 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:35 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.info" returned: 0 in 0.848s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.216s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-09710c04-ee60-45ee-b7e2-a6f3e7f91060 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Create snapshot completed successfully
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "cinder-d4290ba8-d859-4a88-b866-96926fe67ffa-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-d4290ba8-d859-4a88-b866-96926fe67ffa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "cinder-quobyte-49f3873a-248e-4dde-80b5-21430cba8369" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-quobyte-49f3873a-248e-4dde-80b5-21430cba8369" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "cinder-quobyte-d4290ba8-d859-4a88-b866-96926fe67ffa" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-quobyte-d4290ba8-d859-4a88-b866-96926fe67ffa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Deleting offline snapshot d4290ba8-d859-4a88-b866-96926fe67ffa of volume 49f3873a-248e-4dde-80b5-21430cba8369 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] snapshot_file for this snap is: volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e1db1-9b1e-4e9d-8f52-9981e474bb1b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:37 devstack sudo[96264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa
Jun 24 04:14:37 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:38 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa" returned: 0 in 0.923s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49f3873a-248e-4dde-80b5-21430cba8369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:14:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd2ced-249d-453c-9e9d-6891d6e25e6c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:38 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369
Jun 24 04:14:38 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:39 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369" returned: 0 in 0.908s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:39 devstack sudo[96276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa
Jun 24 04:14:39 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:40 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa" returned: 0 in 0.874s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:40 devstack sudo[96282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa
Jun 24 04:14:40 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:41 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369.d4290ba8-d859-4a88-b866-96926fe67ffa" returned: 0 in 0.832s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=58,cinder:UPDATE=70,cinder:INSERT=18,cinder:DELETE=5 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=58,cinder:UPDATE=72,cinder:DELETE=8,cinder:INSERT=14 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-quobyte-d4290ba8-d859-4a88-b866-96926fe67ffa" released by "_delete_snapshot" :: held 3.708s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-quobyte-49f3873a-248e-4dde-80b5-21430cba8369" released by "delete_snapshot" :: held 3.737s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Created reservations ['22a3e25a-b312-4da1-8eb4-22fca3f8377f', 'ae32826c-ba66-49ba-bf0d-e075b2d3e6b7', '49027c4d-e8ce-4698-b86f-be09cb319a8c', '9b04b927-c14d-4bb7-989f-520043f919ef'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:14:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Delete snapshot completed successfully.
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4621325-64b5-4e82-af71-52d1a01b56ef tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-d4290ba8-d859-4a88-b866-96926fe67ffa-delete_snapshot" released by "delete_snapshot" :: held 3.938s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "cinder-49f3873a-248e-4dde-80b5-21430cba8369-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-49f3873a-248e-4dde-80b5-21430cba8369-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "cinder-quobyte-49f3873a-248e-4dde-80b5-21430cba8369" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-quobyte-49f3873a-248e-4dde-80b5-21430cba8369" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2520b7a9-4fe1-4d6e-a1e9-89de7a061b58]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Flow 'volume_create_manager' (3df086f3-1cf1-4125-8d2c-c37a8af7c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a092f30a-2112-4031-ad45-801214c2aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a092f30a-2112-4031-ad45-801214c2aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-349748823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e3af2f-5370-4a55-9e99-cea5bea4c03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12000269520436c9097625cfc6c964c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:42Z,use_quota=True,user_id='f39462cedbde47f78a9e33f750c2a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d101b599-a996-4e63-a7fa-e61fce581278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d101b599-a996-4e63-a7fa-e61fce581278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39722023-92b8-494e-aae9-9557a4896063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39722023-92b8-494e-aae9-9557a4896063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e3af2f-5370-4a55-9e99-cea5bea4c03a', 'volume_name': 'volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14392dec-eb57-43ed-9529-175f4e4d93e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14392dec-eb57-43ed-9529-175f4e4d93e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fd7d1a-4a26-46e1-9f7d-8f87da37db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Volume 87e3af2f-5370-4a55-9e99-cea5bea4c03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a', 'volume_size': 1}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-349748823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e3af2f-5370-4a55-9e99-cea5bea4c03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e12000269520436c9097625cfc6c964c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:42Z,use_quota=True,user_id='f39462cedbde47f78a9e33f750c2a2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Creating volume 87e3af2f-5370-4a55-9e99-cea5bea4c03a {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:42 devstack sudo[96288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369
Jun 24 04:14:42 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:14:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:42 devstack sudo[96290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a 1073741824
Jun 24 04:14:42 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:42 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369" returned: 0 in 1.031s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:42 devstack sudo[96300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369
Jun 24 04:14:42 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:43 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a 1073741824" returned: 0 in 1.102s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:43 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a
Jun 24 04:14:43 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:43 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-49f3873a-248e-4dde-80b5-21430cba8369" returned: 0 in 0.737s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-quobyte-49f3873a-248e-4dde-80b5-21430cba8369" released by "delete_volume" :: held 1.852s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Created reservations ['2d1ad123-cf86-44b7-b875-adf0e476bd3a', 'e3867ebc-020e-4b1a-80ea-28ff08bcd0df', 'b8f1c808-5534-4168-83b3-283be8ba6793', 'f4bb802b-445a-40ba-b46d-ca3fd6c7c3a6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:43 devstack sudo[96305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:14:43 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:44 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a" returned: 0 in 0.730s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fd7d1a-4a26-46e1-9f7d-8f87da37db75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d25cd2-b0ec-4ae2-a301-4aff83b121fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Volume volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a (87e3af2f-5370-4a55-9e99-cea5bea4c03a): created successfully
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d25cd2-b0ec-4ae2-a301-4aff83b121fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Flow 'volume_create_manager' (3df086f3-1cf1-4125-8d2c-c37a8af7c49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cd1261b4-6ab6-402e-8151-29633307246b tempest-AttachVolumeShelveTestJSON-1178354654 None] Created volume successfully.
Jun 24 04:14:44 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.778s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Deleted volume successfully.
Jun 24 04:14:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dac38409-fb0d-4eb5-98d9-028161df02c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-782963427 None] Lock "cinder-49f3873a-248e-4dde-80b5-21430cba8369-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Flow 'volume_create_manager' (73d768ff-2e85-4283-9593-d2dceafa4a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1b824f-36e3-44bd-a78d-4cdfb16b9b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1b824f-36e3-44bd-a78d-4cdfb16b9b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-613232021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5898e7e3-0268-406b-99e2-61b6c4591a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a3212c97643f5ab170fd9b382abd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:52Z,use_quota=True,user_id='1ba8cc58eab7407c958ea768c9fa6dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a367b1bb-4be4-4e95-ba58-1c7a0fd553ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a367b1bb-4be4-4e95-ba58-1c7a0fd553ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f25b7cae-1651-465c-9789-02646f864da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f25b7cae-1651-465c-9789-02646f864da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5898e7e3-0268-406b-99e2-61b6c4591a2a', 'volume_name': 'volume-5898e7e3-0268-406b-99e2-61b6c4591a2a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33528bf-5df7-4508-99f4-00c787e137d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33528bf-5df7-4508-99f4-00c787e137d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4782c347-9c7b-4664-bca5-eb9f2c36d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Volume 5898e7e3-0268-406b-99e2-61b6c4591a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5898e7e3-0268-406b-99e2-61b6c4591a2a', 'volume_size': 1}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-613232021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5898e7e3-0268-406b-99e2-61b6c4591a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a3212c97643f5ab170fd9b382abd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:14:52Z,use_quota=True,user_id='1ba8cc58eab7407c958ea768c9fa6dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Creating volume 5898e7e3-0268-406b-99e2-61b6c4591a2a {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:14:52 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:14:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:52 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a 1073741824
Jun 24 04:14:52 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:53 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a 1073741824" returned: 0 in 1.029s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:53 devstack sudo[96375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a
Jun 24 04:14:53 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:54 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a" returned: 0 in 1.002s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:14:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4782c347-9c7b-4664-bca5-eb9f2c36d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5898e7e3-0268-406b-99e2-61b6c4591a2a', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac66ff5-baa0-4a6d-a8c6-54b2cb707e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:14:54 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Volume volume-5898e7e3-0268-406b-99e2-61b6c4591a2a (5898e7e3-0268-406b-99e2-61b6c4591a2a): created successfully
Jun 24 04:14:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac66ff5-baa0-4a6d-a8c6-54b2cb707e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:14:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Flow 'volume_create_manager' (73d768ff-2e85-4283-9593-d2dceafa4a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:14:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6d30237a-757b-4323-b424-a97e2065c944 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Created volume successfully.
Jun 24 04:14:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Acquiring lock "cinder-5898e7e3-0268-406b-99e2-61b6c4591a2a-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "cinder-5898e7e3-0268-406b-99e2-61b6c4591a2a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Acquiring lock "cinder-quobyte-5898e7e3-0268-406b-99e2-61b6c4591a2a" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:14:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "cinder-quobyte-5898e7e3-0268-406b-99e2-61b6c4591a2a" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:14:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88f8cc7-a8f5-4bca-8327-9dd9461b2d73]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:14:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:56 devstack sudo[96380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a
Jun 24 04:14:56 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:57 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a" returned: 0 in 0.902s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:57 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a
Jun 24 04:14:57 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:58 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5898e7e3-0268-406b-99e2-61b6c4591a2a" returned: 0 in 0.696s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "cinder-quobyte-5898e7e3-0268-406b-99e2-61b6c4591a2a" released by "delete_volume" :: held 1.651s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Created reservations ['19bdb752-4ac2-46af-8f48-a1fa01d2b150', '61d509ab-2722-46f4-9344-78bb2d6173c9', '823626ab-9a16-4b00-877e-6bf9824253b2', '0b399080-3043-41fe-a356-fe52c8ddacf1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:14:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:14:58 devstack sudo[96388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:14:58 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:14:59 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root
Jun 24 04:14:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.697s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:14:59 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:14:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Deleted volume successfully.
Jun 24 04:14:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ba60cdfe-3a2d-43be-a2bb-147b1178a423 tempest-VolumeQuotasNegativeTestJSON-79001633 None] Lock "cinder-5898e7e3-0268-406b-99e2-61b6c4591a2a-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:15:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:01 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:15:01 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:02 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:15:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 8 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:15:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:15:08 devstack cinder-volume[93468]: WARNING py.warnings [req-6ef57232-f209-4de3-a558-46b22f6bbccf req-c50dfd6b-24af-4b3c-8166-1349cf493f64 tempest-AttachVolumeShelveTestJSON-1178354654 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jun 24 04:15:08 devstack cinder-volume[93468]:   .first()
Jun 24 04:15:08 devstack cinder-volume[93468]: 
Jun 24 04:15:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-6ef57232-f209-4de3-a558-46b22f6bbccf req-c50dfd6b-24af-4b3c-8166-1349cf493f64 tempest-AttachVolumeShelveTestJSON-1178354654 None] No connector for attachment 3a9f390f-ea58-4964-a891-75a054b2b314; skipping storage backend terminate_connection call. {{(pid=93468) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jun 24 04:15:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-6ef57232-f209-4de3-a558-46b22f6bbccf req-c50dfd6b-24af-4b3c-8166-1349cf493f64 tempest-AttachVolumeShelveTestJSON-1178354654 None] Deleting attachment 3a9f390f-ea58-4964-a891-75a054b2b314. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Flow 'volume_create_manager' (9284b2ce-a50e-406c-a357-009cf083d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05bd788-61f8-4fa7-92bd-a17f5fa8eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05bd788-61f8-4fa7-92bd-a17f5fa8eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1465984429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71932ba-f2a9-4bb9-8047-0586e9934813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca141520a64e0bb0818d77133af738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:16Z,use_quota=True,user_id='971cf6a2696e43998b37ddf2f8d9b64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3847a1cd-f374-4bf3-aa73-618f42c9a207),volume_type_id=3847a1cd-f374-4bf3-aa73-618f42c9a207)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f884710d-e1e5-46e4-8fa4-65986ca4bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f884710d-e1e5-46e4-8fa4-65986ca4bc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d1f9e9-8c75-45b2-a129-4ad1c8559e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d1f9e9-8c75-45b2-a129-4ad1c8559e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71932ba-f2a9-4bb9-8047-0586e9934813', 'volume_name': 'volume-c71932ba-f2a9-4bb9-8047-0586e9934813', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c92dda-c04a-4d31-b265-110a3363e2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c92dda-c04a-4d31-b265-110a3363e2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab19ea46-158c-475e-b984-3c8c3952b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Volume c71932ba-f2a9-4bb9-8047-0586e9934813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71932ba-f2a9-4bb9-8047-0586e9934813', 'volume_size': 1}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1465984429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71932ba-f2a9-4bb9-8047-0586e9934813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ca141520a64e0bb0818d77133af738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:16Z,use_quota=True,user_id='971cf6a2696e43998b37ddf2f8d9b64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3847a1cd-f374-4bf3-aa73-618f42c9a207),volume_type_id=3847a1cd-f374-4bf3-aa73-618f42c9a207)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Creating volume c71932ba-f2a9-4bb9-8047-0586e9934813 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:15:16 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:15:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:16 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813 1073741824
Jun 24 04:15:16 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:17 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813 1073741824" returned: 0 in 0.986s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:17 devstack sudo[96444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813
Jun 24 04:15:17 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:17 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813" returned: 0 in 0.681s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab19ea46-158c-475e-b984-3c8c3952b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71932ba-f2a9-4bb9-8047-0586e9934813', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3983a6-5eb7-48bf-91f3-07df5e0b1de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:17 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Volume volume-c71932ba-f2a9-4bb9-8047-0586e9934813 (c71932ba-f2a9-4bb9-8047-0586e9934813): created successfully
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f3983a6-5eb7-48bf-91f3-07df5e0b1de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Flow 'volume_create_manager' (9284b2ce-a50e-406c-a357-009cf083d06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2463f60a-2cf7-4d97-85ba-1632e8172974 tempest-VolumeTypesAccessTest-648662373 None] Created volume successfully.
Jun 24 04:15:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Acquiring lock "cinder-c71932ba-f2a9-4bb9-8047-0586e9934813-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Lock "cinder-c71932ba-f2a9-4bb9-8047-0586e9934813-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Acquiring lock "cinder-quobyte-c71932ba-f2a9-4bb9-8047-0586e9934813" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Lock "cinder-quobyte-c71932ba-f2a9-4bb9-8047-0586e9934813" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:18 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b76c25-d06c-4e99-8c02-cd15c78cb321]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:18 devstack sudo[96453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813
Jun 24 04:15:18 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:19 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813" returned: 0 in 1.198s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:19 devstack sudo[96508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813
Jun 24 04:15:19 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:20 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c71932ba-f2a9-4bb9-8047-0586e9934813" returned: 0 in 1.064s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Lock "cinder-quobyte-c71932ba-f2a9-4bb9-8047-0586e9934813" released by "delete_volume" :: held 2.352s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:20 devstack cinder-volume[93468]: WARNING cinder.quota [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1376178770 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1376178770, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:15:20 devstack cinder-volume[93468]: WARNING cinder.quota [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1376178770 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1376178770, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Created reservations ['35f6f530-7ba4-4db0-b4a3-202ec8df7876', '11c2a80d-c0f7-49d3-8835-9a37e62539a1', '10309110-79c6-41b8-b207-5b03210f16ff', '1b32fdb9-1360-493c-8d6f-fae1aaa4651b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:20 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:15:20 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:21 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Deleted volume successfully.
Jun 24 04:15:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a443ffa8-7f4b-4854-b98d-e39de4cce7ff tempest-VolumeTypesAccessTest-648662373 None] Lock "cinder-c71932ba-f2a9-4bb9-8047-0586e9934813-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Flow 'volume_create_manager' (6cd8cb64-650e-4475-9fb5-2d103a5d71ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e086d67a-2d6b-471a-8b79-7ef43a865c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e086d67a-2d6b-471a-8b79-7ef43a865c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1289260658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cf6f8d-327e-4b17-9497-261d0316ae01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ecba9dd15d64e53917369bfe8fc8e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:30Z,use_quota=True,user_id='1641e35ef833471a9f261cfcb78c9caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4857f464-825f-4791-a4c8-38c357089199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4857f464-825f-4791-a4c8-38c357089199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2cef7a-107e-4d92-9e7b-3c0f03105193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2cef7a-107e-4d92-9e7b-3c0f03105193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cf6f8d-327e-4b17-9497-261d0316ae01', 'volume_name': 'volume-00cf6f8d-327e-4b17-9497-261d0316ae01', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9b6bd3-4d5a-446a-9cee-f5f0ae48aa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9b6bd3-4d5a-446a-9cee-f5f0ae48aa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11518e99-b0a3-43cd-9b74-42bb85c6e505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:30 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Volume 00cf6f8d-327e-4b17-9497-261d0316ae01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cf6f8d-327e-4b17-9497-261d0316ae01', 'volume_size': 1}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1289260658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cf6f8d-327e-4b17-9497-261d0316ae01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ecba9dd15d64e53917369bfe8fc8e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:30Z,use_quota=True,user_id='1641e35ef833471a9f261cfcb78c9caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Creating volume 00cf6f8d-327e-4b17-9497-261d0316ae01 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:15:30 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:15:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:30 devstack sudo[96583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01 1073741824
Jun 24 04:15:30 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:31 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01 1073741824" returned: 0 in 1.379s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:31 devstack sudo[96607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01
Jun 24 04:15:31 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:33 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01" returned: 0 in 1.177s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] <== create_volume: return (2695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:15:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11518e99-b0a3-43cd-9b74-42bb85c6e505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cf6f8d-327e-4b17-9497-261d0316ae01', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7e216f-f7c3-4155-9c05-5fcb0e763ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Volume volume-00cf6f8d-327e-4b17-9497-261d0316ae01 (00cf6f8d-327e-4b17-9497-261d0316ae01): created successfully
Jun 24 04:15:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7e216f-f7c3-4155-9c05-5fcb0e763ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Flow 'volume_create_manager' (6cd8cb64-650e-4475-9fb5-2d103a5d71ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-65dee943-d5a0-4f34-93a1-f2946967ea98 tempest-DeleteServersTestJSON-620348400 None] Created volume successfully.
Jun 24 04:15:41 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=32,cinder:INSERT=11,cinder:UPDATE=41,cinder:DELETE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:15:41 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=28,cinder:INSERT=9,cinder:UPDATE=43,cinder:DELETE=5 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:15:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-5043672b-59dd-4255-8d32-15c9fcd8b78e req-d023aca2-9ca4-43c7-b801-cd8ee14ed767 tempest-DeleteServersTestJSON-620348400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-5043672b-59dd-4255-8d32-15c9fcd8b78e req-d023aca2-9ca4-43c7-b801-cd8ee14ed767 tempest-DeleteServersTestJSON-620348400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f80e055-3b84-4062-be20-2ffce69e94f2]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-5043672b-59dd-4255-8d32-15c9fcd8b78e req-d023aca2-9ca4-43c7-b801-cd8ee14ed767 tempest-DeleteServersTestJSON-620348400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:41 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01
Jun 24 04:15:41 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:42 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-5043672b-59dd-4255-8d32-15c9fcd8b78e req-d023aca2-9ca4-43c7-b801-cd8ee14ed767 tempest-DeleteServersTestJSON-620348400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01" returned: 0 in 1.542s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-5043672b-59dd-4255-8d32-15c9fcd8b78e req-d023aca2-9ca4-43c7-b801-cd8ee14ed767 tempest-DeleteServersTestJSON-620348400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.577s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-5043672b-59dd-4255-8d32-15c9fcd8b78e req-d023aca2-9ca4-43c7-b801-cd8ee14ed767 tempest-DeleteServersTestJSON-620348400 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-00cf6f8d-327e-4b17-9497-261d0316ae01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '396ca22b-9dbe-4655-a124-a07382dca045', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:15:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-5043672b-59dd-4255-8d32-15c9fcd8b78e req-d023aca2-9ca4-43c7-b801-cd8ee14ed767 tempest-DeleteServersTestJSON-620348400 None] attachment_update completed successfully.
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (14f1832d-ad8e-4930-aae8-aae5a98cd9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d94fae-babc-4181-a347-9db9c8b3c8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d94fae-babc-4181-a347-9db9c8b3c8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1005349722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae80f58-1381-44e5-85e3-99205a3eb749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:47Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f650a6-058c-41cb-b296-1eae84b5268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f650a6-058c-41cb-b296-1eae84b5268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b19173-10c8-4819-87a7-4255bd19d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b19173-10c8-4819-87a7-4255bd19d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae80f58-1381-44e5-85e3-99205a3eb749', 'volume_name': 'volume-0ae80f58-1381-44e5-85e3-99205a3eb749', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f33ac1-1f7b-4d79-9f1e-cc31663190ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f33ac1-1f7b-4d79-9f1e-cc31663190ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cb194c-cfe3-4b33-bd10-25e74e1fc246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Volume 0ae80f58-1381-44e5-85e3-99205a3eb749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae80f58-1381-44e5-85e3-99205a3eb749', 'volume_size': 1}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1005349722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae80f58-1381-44e5-85e3-99205a3eb749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:47Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Creating volume 0ae80f58-1381-44e5-85e3-99205a3eb749 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:15:46 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:15:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:46 devstack sudo[97302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749 1073741824
Jun 24 04:15:46 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:48 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749 1073741824" returned: 0 in 1.454s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:48 devstack sudo[97313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749
Jun 24 04:15:48 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:49 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749" returned: 0 in 1.298s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] <== create_volume: return (2853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:15:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.856s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cb194c-cfe3-4b33-bd10-25e74e1fc246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae80f58-1381-44e5-85e3-99205a3eb749', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2070b868-5d79-43b4-acc7-c68cb5ee4fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:49 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Volume volume-0ae80f58-1381-44e5-85e3-99205a3eb749 (0ae80f58-1381-44e5-85e3-99205a3eb749): created successfully
Jun 24 04:15:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2070b868-5d79-43b4-acc7-c68cb5ee4fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (14f1832d-ad8e-4930-aae8-aae5a98cd9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3f136ba4-04b6-48ab-8514-e4dd3d38c222 tempest-VolumesActionsTest-1213145465 None] Created volume successfully.
Jun 24 04:15:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-89452c07-1827-4de8-a827-d7106ca51630 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749" by "attach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-89452c07-1827-4de8-a827-d7106ca51630 tempest-VolumesActionsTest-1213145465 None] Lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749" acquired by "attach_volume" :: waited 0.035s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-89452c07-1827-4de8-a827-d7106ca51630 tempest-VolumesActionsTest-1213145465 None] Attaching volume 0ae80f58-1381-44e5-85e3-99205a3eb749 to instance d8134909-f361-4c6c-bef5-3e982ab6aa1f at mountpoint /dev/vdb on host None.
Jun 24 04:15:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-89452c07-1827-4de8-a827-d7106ca51630 tempest-VolumesActionsTest-1213145465 None] Attach volume completed successfully.
Jun 24 04:15:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-89452c07-1827-4de8-a827-d7106ca51630 tempest-VolumesActionsTest-1213145465 None] Lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749" released by "attach_volume" :: held 0.366s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ab6072f-6079-4224-a9ec-2e56b7fb9de5 tempest-VolumesActionsTest-1575382314 None] Terminate volume connection completed successfully.
Jun 24 04:15:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ab6072f-6079-4224-a9ec-2e56b7fb9de5 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-detach_volume" by "detach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ab6072f-6079-4224-a9ec-2e56b7fb9de5 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ab6072f-6079-4224-a9ec-2e56b7fb9de5 tempest-VolumesActionsTest-1575382314 None] Detaching volume 0ae80f58-1381-44e5-85e3-99205a3eb749 from instance d8134909-f361-4c6c-bef5-3e982ab6aa1f.
Jun 24 04:15:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ab6072f-6079-4224-a9ec-2e56b7fb9de5 tempest-VolumesActionsTest-1575382314 None] Detach volume completed successfully.
Jun 24 04:15:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ab6072f-6079-4224-a9ec-2e56b7fb9de5 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f98a06c4-ce83-4679-abac-0848a0dfc761 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-detach_volume" by "detach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f98a06c4-ce83-4679-abac-0848a0dfc761 tempest-VolumesActionsTest-1213145465 None] Lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f98a06c4-ce83-4679-abac-0848a0dfc761 tempest-VolumesActionsTest-1213145465 None] Volume detach called, but volume not attached.
Jun 24 04:15:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f98a06c4-ce83-4679-abac-0848a0dfc761 tempest-VolumesActionsTest-1213145465 None] Lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-a8adbda9-511a-4287-9ed3-db3b7744047c req-d123a1c5-da27-4753-8fb7-b40d25803849 tempest-DeleteServersTestJSON-620348400 None] Terminate volume connection completed successfully.
Jun 24 04:15:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-a8adbda9-511a-4287-9ed3-db3b7744047c req-d123a1c5-da27-4753-8fb7-b40d25803849 tempest-DeleteServersTestJSON-620348400 None] Deleting attachment 396ca22b-9dbe-4655-a124-a07382dca045. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:15:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Acquiring lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Acquiring lock "cinder-quobyte-0ae80f58-1381-44e5-85e3-99205a3eb749" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Lock "cinder-quobyte-0ae80f58-1381-44e5-85e3-99205a3eb749" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc77dc9-bacb-4383-a537-6600702dbbfd]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:56 devstack sudo[97439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749
Jun 24 04:15:56 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:56 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749" returned: 0 in 0.883s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:57 devstack sudo[97445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749
Jun 24 04:15:57 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:57 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0ae80f58-1381-44e5-85e3-99205a3eb749" returned: 0 in 0.827s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Lock "cinder-quobyte-0ae80f58-1381-44e5-85e3-99205a3eb749" released by "delete_volume" :: held 1.764s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Created reservations ['08430d9d-64a0-4214-af8e-12c2721589e3', '7e6cb727-84fa-476b-9698-c8237f74d7c6', 'b24fd5ea-2e4e-46a2-a200-a13e7f47eeb0', '42d8f7b4-73ab-45c4-8bdb-5f2f672e5f98'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:15:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:58 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:15:58 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Flow 'volume_create_manager' (6ce086a2-dabf-493a-996b-5f401b855cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b8e274-6757-4bc2-b199-636714a44867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3b8e274-6757-4bc2-b199-636714a44867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-922792249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdc15a7-2087-4d0a-897e-ba8024edfa75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437edcde93b54b98b721f20ab5233fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:59Z,use_quota=True,user_id='2d909c432ccb405fb51f5d93f861d5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08093b4a-0c16-4d9a-9163-ea13d52b3d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08093b4a-0c16-4d9a-9163-ea13d52b3d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36e4cb4-69fa-4b3e-9f26-09b3f772f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:15:58 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.917s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:15:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Deleted volume successfully.
Jun 24 04:15:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae3ad931-5528-463e-b400-77e89e04531e tempest-VolumesActionsTest-1213145465 None] Lock "cinder-0ae80f58-1381-44e5-85e3-99205a3eb749-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36e4cb4-69fa-4b3e-9f26-09b3f772f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7cdc15a7-2087-4d0a-897e-ba8024edfa75', 'volume_name': 'volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f07997f0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a576e321-4d45-48fb-9dbd-12cf58c67440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a576e321-4d45-48fb-9dbd-12cf58c67440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb166149-1d62-4491-908c-d856d03cd19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:15:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Volume 7cdc15a7-2087-4d0a-897e-ba8024edfa75: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f07997f0>}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Trying to clone 7cdc15a7-2087-4d0a-897e-ba8024edfa75 from image d16527e6-13ec-4d21-b5b6-0410252234f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Acquiring lock "cinder-00cf6f8d-327e-4b17-9497-261d0316ae01-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Lock "cinder-00cf6f8d-327e-4b17-9497-261d0316ae01-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Acquiring lock "cinder-quobyte-00cf6f8d-327e-4b17-9497-261d0316ae01" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Lock "cinder-quobyte-00cf6f8d-327e-4b17-9497-261d0316ae01" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b975f-fdfc-4303-834d-40fa51c1852d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:15:59 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01
Jun 24 04:15:59 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:15:59 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:15:59 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Image download 20.69 MB at 20.69 MB/s
Jun 24 04:16:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c5259-9d4c-4c1c-af14-18b8276060b7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:00 devstack sudo[97519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD
Jun 24 04:16:00 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:00 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:00 devstack sudo[97525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01
Jun 24 04:16:00 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:00 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD" returned: 0 in 0.841s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:00 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Temporary image d16527e6-13ec-4d21-b5b6-0410252234f4 is fetched for user 2d909c432ccb405fb51f5d93f861d5f0. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:16:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca61336d-13ef-4e61-9463-64cccd2d6b58]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:01 devstack sudo[97530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD
Jun 24 04:16:01 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:01 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-00cf6f8d-327e-4b17-9497-261d0316ae01" returned: 0 in 0.645s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Lock "cinder-quobyte-00cf6f8d-327e-4b17-9497-261d0316ae01" released by "delete_volume" :: held 1.784s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Created reservations ['c81a3c15-3bbc-4429-8727-88e7da437056', '1a90d356-6ac2-4c6c-916b-11b3b660a9d3', '2662aeb0-3eb6-40cb-be46-77cde311e046', 'ab3adb81-9e4a-4329-b390-523d2fdf56c9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:01 devstack sudo[97534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:01 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:01 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-922792249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdc15a7-2087-4d0a-897e-ba8024edfa75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437edcde93b54b98b721f20ab5233fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:15:59Z,use_quota=True,user_id='2d909c432ccb405fb51f5d93f861d5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Creating volume 7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:01 devstack sudo[97542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:01 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:01 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:01 devstack sudo[97544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 1073741824
Jun 24 04:16:01 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:02 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.851s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Deleted volume successfully.
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac8f9f0d-54da-4cfd-9f76-ac115e46213c tempest-DeleteServersTestJSON-620348400 None] Lock "cinder-00cf6f8d-327e-4b17-9497-261d0316ae01-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:02 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.691s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:16:02 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 1073741824" returned: 0 in 0.975s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:02 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75
Jun 24 04:16:02 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:03 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75" returned: 0 in 0.725s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:03 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Attempting download of d16527e6-13ec-4d21-b5b6-0410252234f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}])) to volume 7cdc15a7-2087-4d0a-897e-ba8024edfa75. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:16:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd9c57-0206-4249-b66b-bbab63849c70]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_4p0poliz {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:03 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_4p0poliz
Jun 24 04:16:03 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_4p0poliz" returned: 0 in 0.848s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_4p0poliz {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:04 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:04 devstack sudo[97562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_4p0poliz
Jun 24 04:16:04 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:05 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_4p0poliz" returned: 1 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_4p0poliz' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:16:05 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[84807cc5-6096-4c11-aabd-0fa9e3a0e70b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:05 devstack sudo[97566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD
Jun 24 04:16:05 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:06 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] d16527e6-13ec-4d21-b5b6-0410252234f4 was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:06 devstack sudo[97572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75
Jun 24 04:16:06 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (388d0f83-0250-4985-9326-ef65d5a5c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028b963c-0dee-4f8c-ae7b-a32abeaa48bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028b963c-0dee-4f8c-ae7b-a32abeaa48bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1613799876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63c416a-eb1a-4e36-912e-266fd9963647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:07Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8bc5be-1bee-47e2-8240-dd215344de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8bc5be-1bee-47e2-8240-dd215344de90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33885a0-9dee-4f96-8462-e4b3e9b08ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33885a0-9dee-4f96-8462-e4b3e9b08ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f63c416a-eb1a-4e36-912e-266fd9963647', 'volume_name': 'volume-f63c416a-eb1a-4e36-912e-266fd9963647', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdb8a8a-9bb6-4cb3-8fee-b74fea88f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdb8a8a-9bb6-4cb3-8fee-b74fea88f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04022dc1-6146-4591-b3c3-3aa996d05a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Volume f63c416a-eb1a-4e36-912e-266fd9963647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f63c416a-eb1a-4e36-912e-266fd9963647', 'volume_size': 1}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1613799876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63c416a-eb1a-4e36-912e-266fd9963647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:07Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Creating volume f63c416a-eb1a-4e36-912e-266fd9963647 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:07 devstack sudo[97586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647 1073741824
Jun 24 04:16:07 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:08 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647 1073741824" returned: 0 in 1.051s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:08 devstack sudo[97592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647
Jun 24 04:16:08 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:08 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75" returned: 0 in 2.274s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_tf03xgvudevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:16:08 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Converted 112.00 MB image at 49.20 MB/s
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:08 devstack sudo[97594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 1G
Jun 24 04:16:08 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:08 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647" returned: 0 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04022dc1-6146-4591-b3c3-3aa996d05a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63c416a-eb1a-4e36-912e-266fd9963647', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a828a101-3aea-4b34-9e6d-cdc64dedec70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Volume volume-f63c416a-eb1a-4e36-912e-266fd9963647 (f63c416a-eb1a-4e36-912e-266fd9963647): created successfully
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a828a101-3aea-4b34-9e6d-cdc64dedec70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (388d0f83-0250-4985-9326-ef65d5a5c4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d59e494c-6d88-4437-a001-93e4d550e2b2 tempest-VolumesActionsTest-1213145465 None] Created volume successfully.
Jun 24 04:16:09 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 1G" returned: 0 in 0.754s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a47a1f-7dd1-4110-9bb6-8a53cc87ae1a]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:09 devstack sudo[97600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75
Jun 24 04:16:09 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:10 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-f63c416a-eb1a-4e36-912e-266fd9963647-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-f63c416a-eb1a-4e36-912e-266fd9963647-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:10 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75
Jun 24 04:16:10 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-quobyte-f63c416a-eb1a-4e36-912e-266fd9963647" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-quobyte-f63c416a-eb1a-4e36-912e-266fd9963647" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a26bf8-bd8e-4095-909c-69704f80428c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:10 devstack sudo[97606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647
Jun 24 04:16:10 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:10 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75" returned: 1 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Downloaded image d16527e6-13ec-4d21-b5b6-0410252234f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}])) to volume 7cdc15a7-2087-4d0a-897e-ba8024edfa75 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Temporary image d16527e6-13ec-4d21-b5b6-0410252234f4 for user 2d909c432ccb405fb51f5d93f861d5f0 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Marking volume 7cdc15a7-2087-4d0a-897e-ba8024edfa75 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Copying metadata from image d16527e6-13ec-4d21-b5b6-0410252234f4 to 7cdc15a7-2087-4d0a-897e-ba8024edfa75. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:16:10 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Creating volume glance metadata for volume 7cdc15a7-2087-4d0a-897e-ba8024edfa75 backed by image d16527e6-13ec-4d21-b5b6-0410252234f4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:16:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb166149-1d62-4491-908c-d856d03cd19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f07997f0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d899abfd-81c5-4b5b-b1e2-9d494ef7dc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:11 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Volume volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 (7cdc15a7-2087-4d0a-897e-ba8024edfa75): created successfully
Jun 24 04:16:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d899abfd-81c5-4b5b-b1e2-9d494ef7dc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Flow 'volume_create_manager' (6ce086a2-dabf-493a-996b-5f401b855cbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ca2785cf-fef9-4873-84ae-2aecb3e7e972 tempest-VolumesImageMetadata-1626003701 None] Created volume successfully.
Jun 24 04:16:11 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647" returned: 0 in 0.871s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:11 devstack sudo[97614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647
Jun 24 04:16:11 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:11 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f63c416a-eb1a-4e36-912e-266fd9963647" returned: 0 in 0.701s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-quobyte-f63c416a-eb1a-4e36-912e-266fd9963647" released by "delete_volume" :: held 1.616s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Created reservations ['a602d83b-1f73-4c55-9769-c439ba06036f', 'a4b79147-49fd-49a2-b3b7-f8a37dd46927', 'f429df1b-b6ed-49dc-927e-d6e62c30ef8e', '9936bb04-1828-498b-b402-30c3925a406f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Acquiring lock "cinder-7cdc15a7-2087-4d0a-897e-ba8024edfa75-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:12 devstack sudo[97617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:12 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Lock "cinder-7cdc15a7-2087-4d0a-897e-ba8024edfa75-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Acquiring lock "cinder-quobyte-7cdc15a7-2087-4d0a-897e-ba8024edfa75" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Lock "cinder-quobyte-7cdc15a7-2087-4d0a-897e-ba8024edfa75" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f8231c-83a2-4410-ba4d-dbf4d89a59a1]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:12 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75
Jun 24 04:16:12 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:12 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.710s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Deleted volume successfully.
Jun 24 04:16:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6ef2eb28-c007-4576-8a10-76431d93bc43 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-f63c416a-eb1a-4e36-912e-266fd9963647-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:13 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (e7eca198-93c5-490f-a179-44b0cb1aac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f45cf06-5ee0-4e24-9dc7-6b71e49b5241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75" returned: 0 in 0.879s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f45cf06-5ee0-4e24-9dc7-6b71e49b5241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897960688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5261943b-0390-4de2-a47a-5a920e5c4b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:13Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4c484b-67a2-45e2-9ec2-97c7e62eb404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4c484b-67a2-45e2-9ec2-97c7e62eb404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2807e5-d7f8-4c16-a62e-eca7c7c06f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2807e5-d7f8-4c16-a62e-eca7c7c06f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5261943b-0390-4de2-a47a-5a920e5c4b08', 'volume_name': 'volume-5261943b-0390-4de2-a47a-5a920e5c4b08', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afcc058-d212-479f-acb1-9b360b8fcd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afcc058-d212-479f-acb1-9b360b8fcd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63990a15-2104-4305-af63-20bbad44ee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:13 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Volume 5261943b-0390-4de2-a47a-5a920e5c4b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5261943b-0390-4de2-a47a-5a920e5c4b08', 'volume_size': 1}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897960688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5261943b-0390-4de2-a47a-5a920e5c4b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:13Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Creating volume 5261943b-0390-4de2-a47a-5a920e5c4b08 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:13 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:13 devstack sudo[97625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08 1073741824
Jun 24 04:16:13 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:13 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75
Jun 24 04:16:13 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:14 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75" returned: 1 in 1.028s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:16:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:14 devstack sudo[97636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75
Jun 24 04:16:14 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:14 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08 1073741824" returned: 0 in 1.193s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:14 devstack sudo[97638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08
Jun 24 04:16:14 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:14 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7cdc15a7-2087-4d0a-897e-ba8024edfa75" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Lock "cinder-quobyte-7cdc15a7-2087-4d0a-897e-ba8024edfa75" released by "delete_volume" :: held 2.847s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Created reservations ['3996d1c3-7264-4ef0-adcb-2bdf78b1ce60', '5a6d8bbb-ed32-419c-b6fa-028791f29f07', '0258adc8-814f-473c-b24c-6aabce2bc957', 'cd9989bf-e2b1-4886-8ea4-01c2fef6b176'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:15 devstack sudo[97642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:15 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:15 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08" returned: 0 in 0.950s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63990a15-2104-4305-af63-20bbad44ee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5261943b-0390-4de2-a47a-5a920e5c4b08', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8408a2-ec37-4915-929f-851c1ab067dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Volume volume-5261943b-0390-4de2-a47a-5a920e5c4b08 (5261943b-0390-4de2-a47a-5a920e5c4b08): created successfully
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8408a2-ec37-4915-929f-851c1ab067dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (e7eca198-93c5-490f-a179-44b0cb1aac58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1cfc7045-d272-4d5b-82de-04c4456e1e4d tempest-VolumesActionsTest-1213145465 None] Created volume successfully.
Jun 24 04:16:16 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.899s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Deleted volume successfully.
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2fb17f74-e06d-4d08-893b-49197b95c1ff tempest-VolumesImageMetadata-1626003701 None] Lock "cinder-7cdc15a7-2087-4d0a-897e-ba8024edfa75-delete_volume" released by "delete_volume" :: held 4.097s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-5261943b-0390-4de2-a47a-5a920e5c4b08-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-5261943b-0390-4de2-a47a-5a920e5c4b08-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-quobyte-5261943b-0390-4de2-a47a-5a920e5c4b08" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-quobyte-5261943b-0390-4de2-a47a-5a920e5c4b08" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a46a88-f940-4329-bf0a-ccf09bdd0625]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:16 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08
Jun 24 04:16:16 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:17 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08" returned: 0 in 1.010s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:17 devstack sudo[97652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08
Jun 24 04:16:17 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:18 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5261943b-0390-4de2-a47a-5a920e5c4b08" returned: 0 in 0.849s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-quobyte-5261943b-0390-4de2-a47a-5a920e5c4b08" released by "delete_volume" :: held 1.931s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Created reservations ['533e844b-0476-4822-95de-5f59616c56b1', '6ca1bc1f-2aa7-4f4d-b6f8-d29bad67b186', '79a8fe11-29fa-499c-8108-2760f5013b69', 'b36552e3-4b48-4e0e-8189-0243e13c8992'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:18 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:18 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:19 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.002s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:19 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Deleted volume successfully.
Jun 24 04:16:19 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (d1db71ab-80b8-4499-bec5-e0138d7c60ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3fe5a3-8710-49c5-908c-ff1227536ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3fe5a3-8710-49c5-908c-ff1227536ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2077267193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5641f9-9ec1-44f6-bd72-011af23d33a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:20Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dabeb6-48a4-454a-b9bf-2084cb6efd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dabeb6-48a4-454a-b9bf-2084cb6efd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eca4973-3a54-4b03-9e1e-83ebf9d1b29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eca4973-3a54-4b03-9e1e-83ebf9d1b29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5641f9-9ec1-44f6-bd72-011af23d33a2', 'volume_name': 'volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9b597d-362c-4eb4-95e6-9d948029d410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9b597d-362c-4eb4-95e6-9d948029d410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e456c3e6-b0a1-4263-a54a-7ce53fad4fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:20 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Volume ae5641f9-9ec1-44f6-bd72-011af23d33a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2', 'volume_size': 1}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2077267193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5641f9-9ec1-44f6-bd72-011af23d33a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:20Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Creating volume ae5641f9-9ec1-44f6-bd72-011af23d33a2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:20 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-be562c39-465e-476a-9de7-bc31d151c6b8 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-5261943b-0390-4de2-a47a-5a920e5c4b08-delete_volume" released by "delete_volume" :: held 3.550s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:20 devstack sudo[97669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2 1073741824
Jun 24 04:16:20 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:21 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2 1073741824" returned: 0 in 1.314s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:21 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2
Jun 24 04:16:21 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Flow 'volume_create_manager' (0aef540e-87fb-4fc3-bc59-0ba9e7db06a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e02e7e-3003-43a4-b9b3-ac0484ab1b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e02e7e-3003-43a4-b9b3-ac0484ab1b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1323035674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f766281d414f2c9cd706f1af986eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:21Z,use_quota=True,user_id='b06a5f66f2404b6db38886f7b9f189e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ab4880-c1dc-4096-bde9-7e4f175f323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ab4880-c1dc-4096-bde9-7e4f175f323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ded99e-22ab-4c08-983a-9973701ee29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ded99e-22ab-4c08-983a-9973701ee29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4', 'volume_name': 'volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcf9f7e-0372-476d-9003-fd06d7570664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcf9f7e-0372-476d-9003-fd06d7570664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cc0516-da98-44e3-a741-cfb471591aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:21 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Volume e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4', 'volume_size': 1}
Jun 24 04:16:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:22 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2" returned: 0 in 0.755s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1323035674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f766281d414f2c9cd706f1af986eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:21Z,use_quota=True,user_id='b06a5f66f2404b6db38886f7b9f189e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Creating volume e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:22 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:22 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 1073741824
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e456c3e6-b0a1-4263-a54a-7ce53fad4fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:22 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600f6a83-05ac-494a-8f59-651dfb0807ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Volume volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2 (ae5641f9-9ec1-44f6-bd72-011af23d33a2): created successfully
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600f6a83-05ac-494a-8f59-651dfb0807ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (d1db71ab-80b8-4499-bec5-e0138d7c60ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c5cf4f38-df37-49fc-a8ed-9b69a3a42fbd tempest-VolumesActionsTest-1213145465 None] Created volume successfully.
Jun 24 04:16:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-ae5641f9-9ec1-44f6-bd72-011af23d33a2-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-ae5641f9-9ec1-44f6-bd72-011af23d33a2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-quobyte-ae5641f9-9ec1-44f6-bd72-011af23d33a2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:23 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-quobyte-ae5641f9-9ec1-44f6-bd72-011af23d33a2" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 1073741824" returned: 0 in 1.100s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cc8968-a35a-49eb-a396-724e66fe227e]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:23 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4
Jun 24 04:16:23 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:23 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2
Jun 24 04:16:23 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:24 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cc0516-da98-44e3-a741-cfb471591aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821d2e12-8664-4aec-9b33-cf1d69eb1dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Volume volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 (e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4): created successfully
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821d2e12-8664-4aec-9b33-cf1d69eb1dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Flow 'volume_create_manager' (0aef540e-87fb-4fc3-bc59-0ba9e7db06a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c0870978-b47d-46f9-82e9-4983de537f5f tempest-SnapshotMetadataTestJSON-194100297 None] Created volume successfully.
Jun 24 04:16:24 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2" returned: 0 in 1.000s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:24 devstack sudo[97743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2
Jun 24 04:16:24 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Creating offline snapshot dc16baf3-df12-4a6e-b69b-132bbf4100cf of volume e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dd8693-5b4b-4b99-840b-894442796a49]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:25 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ae5641f9-9ec1-44f6-bd72-011af23d33a2" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-quobyte-ae5641f9-9ec1-44f6-bd72-011af23d33a2" released by "delete_volume" :: held 1.921s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:25 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4
Jun 24 04:16:25 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Created reservations ['dca0cc11-8a06-4223-ae83-7c3faea98224', '8cca23c4-ddc1-4ad6-9ab2-929481e4dcf6', 'fba81fe3-9005-4d49-84e5-4f3483705de4', '996a690c-c7d9-42e7-ac31-e0be5cce6c75'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:25 devstack sudo[97748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:25 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:26 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:26 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (ef1bf861-10f3-4bff-98c8-e7e6f45f0624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b13d9e5-c2b0-4cf3-91c7-a0d448c98f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.922s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" returned: 0 in 1.212s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Deleted volume successfully.
Jun 24 04:16:26 devstack sudo[97754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf 1G
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b13d9e5-c2b0-4cf3-91c7-a0d448c98f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2079255974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dd9c39-9a93-43e8-9048-8b754ff19da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:26Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:26 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc75d80-a550-488a-8521-214b59d9d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc75d80-a550-488a-8521-214b59d9d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b8a6b2-a3cb-4c17-9a53-1bf8a6960e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b8a6b2-a3cb-4c17-9a53-1bf8a6960e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75dd9c39-9a93-43e8-9048-8b754ff19da6', 'volume_name': 'volume-75dd9c39-9a93-43e8-9048-8b754ff19da6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cf29cc-6797-4930-9d2a-b151743462f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cf29cc-6797-4930-9d2a-b151743462f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8493fcb4-b988-419a-b4cf-285a9b1573e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Volume 75dd9c39-9a93-43e8-9048-8b754ff19da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75dd9c39-9a93-43e8-9048-8b754ff19da6', 'volume_size': 1}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-305d532c-6ea2-48c2-b1c8-0c87bc811e15 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-ae5641f9-9ec1-44f6-bd72-011af23d33a2-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:27 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf 1G" returned: 0 in 1.002s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:27 devstack sudo[97762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf
Jun 24 04:16:27 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:28 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf" returned: 0 in 0.865s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:28 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf is being set with open permissions: ugo+rw
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:28 devstack sudo[97768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf
Jun 24 04:16:28 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Acquiring lock "cinder-87e3af2f-5370-4a55-9e99-cea5bea4c03a-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "cinder-87e3af2f-5370-4a55-9e99-cea5bea4c03a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Acquiring lock "cinder-quobyte-87e3af2f-5370-4a55-9e99-cea5bea4c03a" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "cinder-quobyte-87e3af2f-5370-4a55-9e99-cea5bea4c03a" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dcafdd-287e-4bdf-a861-73cb7e72193f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:28 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf" returned: 0 in 0.742s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:29 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.info
Jun 24 04:16:29 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:29 devstack sudo[97771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a
Jun 24 04:16:29 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:29 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.info" returned: 0 in 0.718s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:29 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.info is being set with open permissions: ugo+rw
Jun 24 04:16:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:29 devstack sudo[97780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.info
Jun 24 04:16:29 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:29 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a" returned: 0 in 0.851s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:29 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a
Jun 24 04:16:29 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:30 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.info" returned: 0 in 0.745s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.402s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2079255974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dd9c39-9a93-43e8-9048-8b754ff19da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:26Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Creating volume 75dd9c39-9a93-43e8-9048-8b754ff19da6 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:30 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:30 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6 1073741824
Jun 24 04:16:30 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-375d5fcc-ddc8-415f-b442-3aaf2c73843a tempest-SnapshotMetadataTestJSON-194100297 None] Create snapshot completed successfully
Jun 24 04:16:30 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-87e3af2f-5370-4a55-9e99-cea5bea4c03a" returned: 0 in 0.813s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "cinder-quobyte-87e3af2f-5370-4a55-9e99-cea5bea4c03a" released by "delete_volume" :: held 1.718s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Created reservations ['78376aa6-8f4b-491b-896c-f0df4ddfdfa3', '56c07693-bbb9-4bdd-b7fd-a8198af1d5c6', '292602fd-524a-468e-874c-e5db68187944', '743c3d87-126f-4ec9-beaf-3ba5563feff2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:30 devstack sudo[97789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:30 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:31 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.976s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:31 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Deleted volume successfully.
Jun 24 04:16:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2d83ae36-03c9-4b86-824d-43ac8401048d tempest-AttachVolumeShelveTestJSON-1178354654 None] Lock "cinder-87e3af2f-5370-4a55-9e99-cea5bea4c03a-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:31 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6 1073741824" returned: 0 in 1.336s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:31 devstack sudo[97796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6
Jun 24 04:16:31 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "cinder-dc16baf3-df12-4a6e-b69b-132bbf4100cf-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-dc16baf3-df12-4a6e-b69b-132bbf4100cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "cinder-quobyte-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-quobyte-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "cinder-quobyte-dc16baf3-df12-4a6e-b69b-132bbf4100cf" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-quobyte-dc16baf3-df12-4a6e-b69b-132bbf4100cf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Deleting offline snapshot dc16baf3-df12-4a6e-b69b-132bbf4100cf of volume e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] snapshot_file for this snap is: volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d56c55-d789-4ba0-9763-cdea8c8b271f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:32 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf
Jun 24 04:16:32 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:32 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6" returned: 0 in 1.065s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] <== create_volume: return (2455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8493fcb4-b988-419a-b4cf-285a9b1573e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dd9c39-9a93-43e8-9048-8b754ff19da6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352d2363-cf3e-464f-8719-24c251b5dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Volume volume-75dd9c39-9a93-43e8-9048-8b754ff19da6 (75dd9c39-9a93-43e8-9048-8b754ff19da6): created successfully
Jun 24 04:16:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (352d2363-cf3e-464f-8719-24c251b5dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (ef1bf861-10f3-4bff-98c8-e7e6f45f0624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-03ae47e7-429c-442f-9b78-7c3dfed1a4e6 tempest-VolumesActionsTest-1213145465 None] Created volume successfully.
Jun 24 04:16:33 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf" returned: 0 in 0.882s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:16:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f2db65-4034-49a7-977f-ba8ad0b62526]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:33 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4
Jun 24 04:16:33 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-75dd9c39-9a93-43e8-9048-8b754ff19da6-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-75dd9c39-9a93-43e8-9048-8b754ff19da6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "cinder-quobyte-75dd9c39-9a93-43e8-9048-8b754ff19da6" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-quobyte-75dd9c39-9a93-43e8-9048-8b754ff19da6" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d25c520-c16c-40f6-8fcd-6717632e09c0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:34 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6
Jun 24 04:16:34 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:34 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" returned: 0 in 1.039s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:34 devstack sudo[97816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf
Jun 24 04:16:34 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Flow 'volume_create_manager' (d0e00289-1291-44b8-816b-c68f6a0e415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fd45d4-3193-44ad-b740-600db021f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fd45d4-3193-44ad-b740-600db021f38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1242710583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed12df4-4566-4975-b021-cda939bc9ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fd0f6edf964695b31c0a904c822cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:35Z,use_quota=True,user_id='9e856e2b9a474879ad7b4619732994c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832a5899-d5ef-4008-aac7-e8ef6e45775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832a5899-d5ef-4008-aac7-e8ef6e45775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b09cb0-2efc-4a56-821d-15f3c4f89a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b09cb0-2efc-4a56-821d-15f3c4f89a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed12df4-4566-4975-b021-cda939bc9ba1', 'volume_name': 'volume-eed12df4-4566-4975-b021-cda939bc9ba1', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3de7b9-dcf2-434f-8269-befd5cdaf4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3de7b9-dcf2-434f-8269-befd5cdaf4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766a9c38-b2e1-4ee7-b8bd-dd504fb35d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Volume eed12df4-4566-4975-b021-cda939bc9ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed12df4-4566-4975-b021-cda939bc9ba1', 'volume_size': 1}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1242710583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed12df4-4566-4975-b021-cda939bc9ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fd0f6edf964695b31c0a904c822cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:35Z,use_quota=True,user_id='9e856e2b9a474879ad7b4619732994c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Creating volume eed12df4-4566-4975-b021-cda939bc9ba1 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:35 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:35 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6" returned: 0 in 1.139s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:35 devstack sudo[97821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1 1073741824
Jun 24 04:16:35 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:35 devstack sudo[97823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6
Jun 24 04:16:35 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:35 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf" returned: 0 in 1.131s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:35 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf
Jun 24 04:16:35 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:36 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75dd9c39-9a93-43e8-9048-8b754ff19da6" returned: 0 in 0.804s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-quobyte-75dd9c39-9a93-43e8-9048-8b754ff19da6" released by "delete_volume" :: held 2.013s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Created reservations ['27357c68-471b-4a38-981c-ba1e966639c4', '46b6f663-390d-4fc7-82de-ad832379d9d6', 'e29ab5f1-63a4-4d8d-bef4-32d7753df546', '077606fc-a728-472b-9387-e7851662bcaa'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:36 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1 1073741824" returned: 0 in 1.068s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:36 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:36 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:36 devstack sudo[97839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1
Jun 24 04:16:36 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:36 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4.dc16baf3-df12-4a6e-b69b-132bbf4100cf" returned: 0 in 1.012s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-quobyte-dc16baf3-df12-4a6e-b69b-132bbf4100cf" released by "_delete_snapshot" :: held 4.233s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-quobyte-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" released by "delete_snapshot" :: held 4.260s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Created reservations ['1ff69ab4-d9f6-4f76-a935-dd0feff04e59', '62f03b94-2489-4baf-a78f-a826f4d5a437', 'eae05522-2275-4bee-bc1b-4ac00e42ef19', '3d799791-35d9-419d-baf2-5c36a934b2f3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Delete snapshot completed successfully.
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-771b569b-3a7c-41c0-bd4c-3f3e228f2371 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-dc16baf3-df12-4a6e-b69b-132bbf4100cf-delete_snapshot" released by "delete_snapshot" :: held 4.531s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:37 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Deleted volume successfully.
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d7ae0c1-2fd4-48cb-a0e0-ad63fda64585 tempest-VolumesActionsTest-1575382314 None] Lock "cinder-75dd9c39-9a93-43e8-9048-8b754ff19da6-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:37 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1" returned: 0 in 1.005s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766a9c38-b2e1-4ee7-b8bd-dd504fb35d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed12df4-4566-4975-b021-cda939bc9ba1', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948c3387-1281-4250-9202-86c667b27dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Volume volume-eed12df4-4566-4975-b021-cda939bc9ba1 (eed12df4-4566-4975-b021-cda939bc9ba1): created successfully
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948c3387-1281-4250-9202-86c667b27dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Flow 'volume_create_manager' (d0e00289-1291-44b8-816b-c68f6a0e415f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6590edb5-a69f-4ed7-88de-c42eaabfe7a1 tempest-TaggedAttachmentsTest-616521956 None] Created volume successfully.
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (1b2f950e-cc7f-472d-8da2-64892e6a24a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eaf94e9-4205-4838-a591-226b7936624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "cinder-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eaf94e9-4205-4838-a591-226b7936624e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-288528920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f9153d-3ab1-4ee2-afde-7b486c88edab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:38Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a48fd96-3ff7-4182-a267-72791b32ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a48fd96-3ff7-4182-a267-72791b32ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1b7ed7-e02d-4121-ad71-16cda2cd9f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1b7ed7-e02d-4121-ad71-16cda2cd9f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f9153d-3ab1-4ee2-afde-7b486c88edab', 'volume_name': 'volume-34f9153d-3ab1-4ee2-afde-7b486c88edab', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef8021b-c3fe-46e6-9f06-ad4261b8e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef8021b-c3fe-46e6-9f06-ad4261b8e67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e9c1af-dc45-4b82-aeef-56eea80124d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Volume 34f9153d-3ab1-4ee2-afde-7b486c88edab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f9153d-3ab1-4ee2-afde-7b486c88edab', 'volume_size': 1}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-288528920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f9153d-3ab1-4ee2-afde-7b486c88edab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='003e65dd5eb8469bb449fd12161d0935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:38Z,use_quota=True,user_id='05fb8076de7b4a70a1a44def5b9d15bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Creating volume 34f9153d-3ab1-4ee2-afde-7b486c88edab {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:37 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:38 devstack sudo[97881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab 1073741824
Jun 24 04:16:38 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "cinder-quobyte-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-quobyte-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f026417-87cb-44b0-98be-55c326251c7a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:38 devstack sudo[97883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4
Jun 24 04:16:38 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:39 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:39 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab 1073741824" returned: 0 in 1.097s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" returned: 0 in 0.983s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:39 devstack sudo[97893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4
Jun 24 04:16:39 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:39 devstack sudo[97895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab
Jun 24 04:16:39 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:39 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" returned: 0 in 0.823s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-quobyte-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4" released by "delete_volume" :: held 1.887s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Created reservations ['1b1263e0-ec26-4199-945c-d8a56b269f53', '5b7fc7e6-6ff6-4465-a5f6-7199858a3253', '128e70f0-7c6d-48df-90e0-0c37dfdff8fb', 'eef7472d-d4ad-4b34-936d-566d2ef1a975'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:40 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab" returned: 0 in 0.924s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] <== create_volume: return (2093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e9c1af-dc45-4b82-aeef-56eea80124d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f9153d-3ab1-4ee2-afde-7b486c88edab', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea31a868-b3d9-4906-b392-8faed9c665c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Volume volume-34f9153d-3ab1-4ee2-afde-7b486c88edab (34f9153d-3ab1-4ee2-afde-7b486c88edab): created successfully
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea31a868-b3d9-4906-b392-8faed9c665c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Flow 'volume_create_manager' (1b2f950e-cc7f-472d-8da2-64892e6a24a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-85fbc767-6626-4a7c-bf45-95fc9528744d tempest-VolumesActionsTest-1213145465 None] Created volume successfully.
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:40 devstack sudo[97899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:40 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:41 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.844s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:41 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Deleted volume successfully.
Jun 24 04:16:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0f145c74-d193-4659-89fa-59ca8070fcd7 tempest-SnapshotMetadataTestJSON-194100297 None] Lock "cinder-e9924b1e-1361-4a7b-8b3b-a6f4050cc0e4-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "cinder-34f9153d-3ab1-4ee2-afde-7b486c88edab-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Lock "cinder-34f9153d-3ab1-4ee2-afde-7b486c88edab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:42 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=105,cinder:UPDATE=106,cinder:DELETE=6,cinder:INSERT=36 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:16:42 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=81,cinder:UPDATE=120,cinder:INSERT=29,cinder:DELETE=13 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:16:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "cinder-quobyte-34f9153d-3ab1-4ee2-afde-7b486c88edab" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Lock "cinder-quobyte-34f9153d-3ab1-4ee2-afde-7b486c88edab" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a359f017-746c-4729-879c-5d99a0f852e0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:16:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:42 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab
Jun 24 04:16:42 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:43 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab" returned: 0 in 0.934s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:43 devstack sudo[97907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab
Jun 24 04:16:43 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:43 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-34f9153d-3ab1-4ee2-afde-7b486c88edab" returned: 0 in 0.845s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Lock "cinder-quobyte-34f9153d-3ab1-4ee2-afde-7b486c88edab" released by "delete_volume" :: held 1.840s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:44 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Created reservations ['3130808c-26ab-489c-babf-62aee2aaadc5', '9abcc19c-bd0a-4184-9aa3-61a8a8637c5c', 'cc7cf506-45b4-4979-b24a-2f1d6d303038', 'af34e597-9e26-4089-af8d-fa765e027dc1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:16:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:44 devstack sudo[97914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:16:44 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:45 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.046s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:45 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:16:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Deleted volume successfully.
Jun 24 04:16:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c8943b4-d6e0-4951-a6c5-e0d6f2f15ff2 tempest-VolumesActionsTest-1213145465 None] Lock "cinder-34f9153d-3ab1-4ee2-afde-7b486c88edab-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=11 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Flow 'volume_create_manager' (71c5e875-0712-4459-a43d-bcec01925e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da3b26f-4941-435f-9ca0-8fb901ccb6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da3b26f-4941-435f-9ca0-8fb901ccb6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-126910114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617e3e6d-5474-4dd6-b0f9-0c016086a53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a146e55d337341019d7a33cb3e6f5b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:54Z,use_quota=True,user_id='b759cb6529b2433797719d1af5efa6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b773f2-cc96-468a-ae2b-d62473220ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b773f2-cc96-468a-ae2b-d62473220ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b93cb58-8da9-491b-9605-fad81e728628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b93cb58-8da9-491b-9605-fad81e728628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617e3e6d-5474-4dd6-b0f9-0c016086a53c', 'volume_name': 'volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36ae5a1-2f55-4a65-a358-d5fde9d6525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36ae5a1-2f55-4a65-a358-d5fde9d6525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b46d46-9e5a-4851-9e84-2400f7e2bf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:54 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Volume 617e3e6d-5474-4dd6-b0f9-0c016086a53c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c', 'volume_size': 1}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-126910114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617e3e6d-5474-4dd6-b0f9-0c016086a53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a146e55d337341019d7a33cb3e6f5b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:16:54Z,use_quota=True,user_id='b759cb6529b2433797719d1af5efa6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Creating volume 617e3e6d-5474-4dd6-b0f9-0c016086a53c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:16:54 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:16:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:54 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c 1073741824
Jun 24 04:16:54 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:55 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c 1073741824" returned: 0 in 1.066s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:16:55 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c
Jun 24 04:16:55 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:16:56 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Jun 24 04:16:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c" returned: 0 in 0.755s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:16:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:16:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:16:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b46d46-9e5a-4851-9e84-2400f7e2bf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a13d3b-ba04-4b55-9e88-d1832571ff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:16:56 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Volume volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c (617e3e6d-5474-4dd6-b0f9-0c016086a53c): created successfully
Jun 24 04:16:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a13d3b-ba04-4b55-9e88-d1832571ff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:16:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Flow 'volume_create_manager' (71c5e875-0712-4459-a43d-bcec01925e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:16:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9fc88f1e-66d9-4b2b-9f35-461b36d31ae8 tempest-VolumesTransfersTest-1798061244 None] Created volume successfully.
Jun 24 04:16:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-96fd92f0-4e3f-4b01-8012-4ca9996a3036 tempest-VolumesTransfersTest-1994921123 None] Transfer volume completed successfully.
Jun 24 04:16:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Acquiring lock "cinder-617e3e6d-5474-4dd6-b0f9-0c016086a53c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Lock "cinder-617e3e6d-5474-4dd6-b0f9-0c016086a53c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:16:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Acquiring lock "cinder-quobyte-617e3e6d-5474-4dd6-b0f9-0c016086a53c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:16:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Lock "cinder-quobyte-617e3e6d-5474-4dd6-b0f9-0c016086a53c" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e931604-87da-48b8-8806-ad005b0b7abc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:00 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c
Jun 24 04:17:00 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:00 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:00 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c
Jun 24 04:17:00 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:17:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:01 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:17:01 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:02 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-617e3e6d-5474-4dd6-b0f9-0c016086a53c" returned: 0 in 1.543s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Lock "cinder-quobyte-617e3e6d-5474-4dd6-b0f9-0c016086a53c" released by "delete_volume" :: held 2.524s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Created reservations ['3309dbea-32ff-4893-ad05-7624f0b950e4', 'df6d14e1-481f-4926-989f-f66adb2e986e', '347a1f10-71db-4caa-9a10-95a77de72f66', '8fa133f1-5934-4bc1-9c10-3117edd4700a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:02 devstack sudo[98054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:17:02 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:03 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.910s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:03 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:17:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:17:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:17:04 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.754s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:04 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Deleted volume successfully.
Jun 24 04:17:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8039be1a-fbf2-4e30-bb29-72643274e7d4 tempest-VolumesTransfersTest-1903102998 None] Lock "cinder-617e3e6d-5474-4dd6-b0f9-0c016086a53c-delete_volume" released by "delete_volume" :: held 4.759s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Flow 'volume_create_manager' (df2e976b-df7c-40ae-a675-fcf2be66d69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac99b26-3ac6-4f92-b0f7-e8049c9a5f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac99b26-3ac6-4f92-b0f7-e8049c9a5f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1485370244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faade884-3d1d-49dc-b75d-33183d680422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a146e55d337341019d7a33cb3e6f5b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:05Z,use_quota=True,user_id='b759cb6529b2433797719d1af5efa6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17589af3-a087-4ea5-99d5-7558cefdd23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17589af3-a087-4ea5-99d5-7558cefdd23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8343b08f-1fd6-434e-ad29-78b9440ea22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8343b08f-1fd6-434e-ad29-78b9440ea22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faade884-3d1d-49dc-b75d-33183d680422', 'volume_name': 'volume-faade884-3d1d-49dc-b75d-33183d680422', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fede9f7a-4dc1-4d39-8cf5-115688230125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fede9f7a-4dc1-4d39-8cf5-115688230125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84622e81-3a0a-4c86-8184-41b45de294c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Volume faade884-3d1d-49dc-b75d-33183d680422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faade884-3d1d-49dc-b75d-33183d680422', 'volume_size': 1}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1485370244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faade884-3d1d-49dc-b75d-33183d680422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a146e55d337341019d7a33cb3e6f5b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:05Z,use_quota=True,user_id='b759cb6529b2433797719d1af5efa6d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Creating volume faade884-3d1d-49dc-b75d-33183d680422 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:17:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:05 devstack sudo[98079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422 1073741824
Jun 24 04:17:05 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:06 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422 1073741824" returned: 0 in 1.404s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:06 devstack sudo[98087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422
Jun 24 04:17:06 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:07 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422" returned: 0 in 0.864s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84622e81-3a0a-4c86-8184-41b45de294c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faade884-3d1d-49dc-b75d-33183d680422', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96013c28-9975-4054-a60e-2e1291bbc777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Flow 'volume_create_manager' (c0ea7e48-8de8-4f58-b593-1012276cae37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9198f891-9d58-41a6-a8ee-740b03c481a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Volume volume-faade884-3d1d-49dc-b75d-33183d680422 (faade884-3d1d-49dc-b75d-33183d680422): created successfully
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96013c28-9975-4054-a60e-2e1291bbc777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Flow 'volume_create_manager' (df2e976b-df7c-40ae-a675-fcf2be66d69c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9198f891-9d58-41a6-a8ee-740b03c481a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-927397850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32a2681-bb6c-4314-8e71-3bc06ca03341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f18952d8124025a7470a0df5dbd579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:08Z,use_quota=True,user_id='e7425f68b71c466b81b5e4548ef147bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3b3454-877e-4be1-9c68-48464cea49aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3b3454-877e-4be1-9c68-48464cea49aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70dc073e-6d4c-4ccc-a0eb-9d45bb9065e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70dc073e-6d4c-4ccc-a0eb-9d45bb9065e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd32a2681-bb6c-4314-8e71-3bc06ca03341', 'volume_name': 'volume-d32a2681-bb6c-4314-8e71-3bc06ca03341', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0a5cc8-1481-4fad-8cf6-42e168902722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0a5cc8-1481-4fad-8cf6-42e168902722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f8559d-21c9-4150-8a58-c1d867e213bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Volume d32a2681-bb6c-4314-8e71-3bc06ca03341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d32a2681-bb6c-4314-8e71-3bc06ca03341', 'volume_size': 1}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-927397850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32a2681-bb6c-4314-8e71-3bc06ca03341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14f18952d8124025a7470a0df5dbd579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:08Z,use_quota=True,user_id='e7425f68b71c466b81b5e4548ef147bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Creating volume d32a2681-bb6c-4314-8e71-3bc06ca03341 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:17:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-bb0322a0-a152-4283-9965-e20b04e314da tempest-VolumesTransfersTest-1798061244 None] Created volume successfully.
Jun 24 04:17:07 devstack sudo[98091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341 1073741824
Jun 24 04:17:07 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:08 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341 1073741824" returned: 0 in 1.078s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:09 devstack sudo[98098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341
Jun 24 04:17:09 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Acquiring lock "cinder-faade884-3d1d-49dc-b75d-33183d680422-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Lock "cinder-faade884-3d1d-49dc-b75d-33183d680422-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Acquiring lock "cinder-quobyte-faade884-3d1d-49dc-b75d-33183d680422" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Lock "cinder-quobyte-faade884-3d1d-49dc-b75d-33183d680422" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa91d7e1-b18e-4010-b6ef-a2cfb9a5c076]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:09 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422
Jun 24 04:17:09 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:09 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341" returned: 0 in 0.911s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f8559d-21c9-4150-8a58-c1d867e213bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d32a2681-bb6c-4314-8e71-3bc06ca03341', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208486ca-5058-4722-b1d5-b5b61cbcc9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:10 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Volume volume-d32a2681-bb6c-4314-8e71-3bc06ca03341 (d32a2681-bb6c-4314-8e71-3bc06ca03341): created successfully
Jun 24 04:17:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208486ca-5058-4722-b1d5-b5b61cbcc9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Flow 'volume_create_manager' (c0ea7e48-8de8-4f58-b593-1012276cae37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-21ccfdeb-97f1-4b0f-bdd6-e1adcc018de0 tempest-AbsoluteLimitsTests-330844508 None] Created volume successfully.
Jun 24 04:17:10 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422" returned: 0 in 0.959s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:10 devstack sudo[98110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422
Jun 24 04:17:10 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:10 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-faade884-3d1d-49dc-b75d-33183d680422" returned: 0 in 0.694s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Lock "cinder-quobyte-faade884-3d1d-49dc-b75d-33183d680422" released by "delete_volume" :: held 1.726s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Created reservations ['07e2577b-7aae-47f9-8c5e-ba72878ce638', '1327a5c2-b9d5-425c-aac1-fd2dff858df7', '76637226-8a49-49f4-99ae-9189b5fab5db', 'bc35d6df-c7ff-4da4-8971-8fc6404f84fd'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Acquiring lock "cinder-d32a2681-bb6c-4314-8e71-3bc06ca03341-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:11 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:17:11 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Lock "cinder-d32a2681-bb6c-4314-8e71-3bc06ca03341-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Acquiring lock "cinder-quobyte-d32a2681-bb6c-4314-8e71-3bc06ca03341" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Lock "cinder-quobyte-d32a2681-bb6c-4314-8e71-3bc06ca03341" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2d0fc9-ecd1-4df3-aa79-5d3e4c5d1cb1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:11 devstack sudo[98115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341
Jun 24 04:17:11 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:11 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.792s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Deleted volume successfully.
Jun 24 04:17:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9c5ca2c3-053b-4be1-9421-1fbfbfe040fb tempest-VolumesTransfersTest-1903102998 None] Lock "cinder-faade884-3d1d-49dc-b75d-33183d680422-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:12 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341" returned: 0 in 1.034s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:12 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341
Jun 24 04:17:12 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:13 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d32a2681-bb6c-4314-8e71-3bc06ca03341" returned: 0 in 1.395s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Lock "cinder-quobyte-d32a2681-bb6c-4314-8e71-3bc06ca03341" released by "delete_volume" :: held 2.504s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:13 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Created reservations ['58544525-79ae-4a13-995c-298203f8d187', '709a5c35-55c7-4825-98be-1c9080cbc270', 'db422eab-d02c-4858-aafd-f01ea91e680b', '71a44af1-db6f-4750-9ebe-3bfa04eab413'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:14 devstack sudo[98200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:17:14 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:15 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.441s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:15 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Deleted volume successfully.
Jun 24 04:17:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-763a90d4-7280-4404-84fe-aa78daf8745d tempest-AbsoluteLimitsTests-330844508 None] Lock "cinder-d32a2681-bb6c-4314-8e71-3bc06ca03341-delete_volume" released by "delete_volume" :: held 4.375s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Flow 'volume_create_manager' (95471314-445d-4dd9-98d9-d953c765c392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa4c53c-85db-4616-98d9-a6a2a6a358b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa4c53c-85db-4616-98d9-a6a2a6a358b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-764547514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba603639-7bea-4841-8cb9-bef3014c4444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169d756ac3054a6b8a5f028f038774a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:22Z,use_quota=True,user_id='e488dab929e3475698a2c7e45c8a2e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e8ada8-c8a2-4187-8bee-e233f3428a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e8ada8-c8a2-4187-8bee-e233f3428a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee86655-7e42-4673-8363-cbed37c09d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee86655-7e42-4673-8363-cbed37c09d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba603639-7bea-4841-8cb9-bef3014c4444', 'volume_name': 'volume-ba603639-7bea-4841-8cb9-bef3014c4444', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6607e6f-70b1-4f50-adc0-b1fed80c4b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6607e6f-70b1-4f50-adc0-b1fed80c4b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc38a845-10d2-4196-b6a6-c745d131a49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Volume ba603639-7bea-4841-8cb9-bef3014c4444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba603639-7bea-4841-8cb9-bef3014c4444', 'volume_size': 1}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-764547514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba603639-7bea-4841-8cb9-bef3014c4444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169d756ac3054a6b8a5f028f038774a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:22Z,use_quota=True,user_id='e488dab929e3475698a2c7e45c8a2e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Creating volume ba603639-7bea-4841-8cb9-bef3014c4444 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:22 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:17:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:22 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444 1073741824
Jun 24 04:17:22 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:23 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444 1073741824" returned: 0 in 0.955s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:23 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444
Jun 24 04:17:23 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:24 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444" returned: 0 in 0.703s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc38a845-10d2-4196-b6a6-c745d131a49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba603639-7bea-4841-8cb9-bef3014c4444', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d8d3f3-2bd6-41a6-af2e-22c0fdf297af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Volume volume-ba603639-7bea-4841-8cb9-bef3014c4444 (ba603639-7bea-4841-8cb9-bef3014c4444): created successfully
Jun 24 04:17:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d8d3f3-2bd6-41a6-af2e-22c0fdf297af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Flow 'volume_create_manager' (95471314-445d-4dd9-98d9-d953c765c392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4aa63ec4-0979-45f1-a7dd-c48a1343342a tempest-VolumesMetadataTest-7742655 None] Created volume successfully.
Jun 24 04:17:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Acquiring lock "cinder-ba603639-7bea-4841-8cb9-bef3014c4444-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Lock "cinder-ba603639-7bea-4841-8cb9-bef3014c4444-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Acquiring lock "cinder-quobyte-ba603639-7bea-4841-8cb9-bef3014c4444" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Lock "cinder-quobyte-ba603639-7bea-4841-8cb9-bef3014c4444" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf39c3d2-1805-4b86-b546-cfd964d5b36c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:25 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444
Jun 24 04:17:25 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:26 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444" returned: 0 in 1.318s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:26 devstack sudo[98275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444
Jun 24 04:17:26 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:27 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ba603639-7bea-4841-8cb9-bef3014c4444" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Lock "cinder-quobyte-ba603639-7bea-4841-8cb9-bef3014c4444" released by "delete_volume" :: held 2.186s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Created reservations ['dc68e49f-b233-42b4-b29c-afb170afd929', '67a8dc7d-6a1e-4189-aea6-00b2053fea44', '83dfb482-3525-40e0-ad6c-91d664702f19', '7babb218-b85d-4915-ad99-d6f23e2d3e49'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:27 devstack sudo[98281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:17:27 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:28 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.862s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:28 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Deleted volume successfully.
Jun 24 04:17:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c3225f60-ff5a-4d5f-b6a2-48e085d7a884 tempest-VolumesMetadataTest-7742655 None] Lock "cinder-ba603639-7bea-4841-8cb9-bef3014c4444-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Flow 'volume_create_manager' (2b0ea8b5-cf40-4e37-87f2-238f36865799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b071a2c-b483-474a-9823-5a129ef696d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b071a2c-b483-474a-9823-5a129ef696d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-920739884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63698424-4dc4-4cd9-93b6-308fd331d30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c442ac5133c4042b1428ed351e4b974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:34Z,use_quota=True,user_id='f11e4a60405940feb4b72d12649d20c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc46e7b2-16a9-4d02-b99c-5e5384fe2323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc46e7b2-16a9-4d02-b99c-5e5384fe2323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a00dac-a740-43fa-a704-7cc0135f3a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a00dac-a740-43fa-a704-7cc0135f3a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63698424-4dc4-4cd9-93b6-308fd331d30c', 'volume_name': 'volume-63698424-4dc4-4cd9-93b6-308fd331d30c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e27ca0-f7f4-4bd3-8426-e8fde45c913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e27ca0-f7f4-4bd3-8426-e8fde45c913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90447c72-5f60-4682-aa07-c79b8644dd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Volume 63698424-4dc4-4cd9-93b6-308fd331d30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63698424-4dc4-4cd9-93b6-308fd331d30c', 'volume_size': 1}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-920739884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63698424-4dc4-4cd9-93b6-308fd331d30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c442ac5133c4042b1428ed351e4b974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:34Z,use_quota=True,user_id='f11e4a60405940feb4b72d12649d20c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Creating volume 63698424-4dc4-4cd9-93b6-308fd331d30c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:33 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:17:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:33 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c 1073741824
Jun 24 04:17:33 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:34 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c 1073741824" returned: 0 in 1.036s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:34 devstack sudo[98316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c
Jun 24 04:17:34 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:35 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c" returned: 0 in 0.936s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90447c72-5f60-4682-aa07-c79b8644dd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63698424-4dc4-4cd9-93b6-308fd331d30c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd0bc8a-9fb4-4573-bb00-71f7251d7df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Volume volume-63698424-4dc4-4cd9-93b6-308fd331d30c (63698424-4dc4-4cd9-93b6-308fd331d30c): created successfully
Jun 24 04:17:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd0bc8a-9fb4-4573-bb00-71f7251d7df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Flow 'volume_create_manager' (2b0ea8b5-cf40-4e37-87f2-238f36865799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d10bac94-904d-46d9-ad1b-305d88618878 tempest-VolumesTransfersV355Test-828093863 None] Created volume successfully.
Jun 24 04:17:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-42783e08-1be7-447e-ade2-894b481aef28 tempest-VolumesTransfersV355Test-953760890 None] Transfer volume completed successfully.
Jun 24 04:17:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Acquiring lock "cinder-63698424-4dc4-4cd9-93b6-308fd331d30c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Lock "cinder-63698424-4dc4-4cd9-93b6-308fd331d30c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Acquiring lock "cinder-quobyte-63698424-4dc4-4cd9-93b6-308fd331d30c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Lock "cinder-quobyte-63698424-4dc4-4cd9-93b6-308fd331d30c" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06e0af5-f074-4c2f-a3fe-4db4ec53aafc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:39 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c
Jun 24 04:17:39 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:40 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c" returned: 0 in 1.056s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:40 devstack sudo[98416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c
Jun 24 04:17:40 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Flow 'volume_create_manager' (b7137c82-bf46-4e88-9bb7-2963a509eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49715cbe-cfcc-4355-8b12-2b946283f1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49715cbe-cfcc-4355-8b12-2b946283f1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-501520217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb6f308-6362-4054-ab0d-7145c6c99244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1751f018d235430384c77b12f6f53243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:41Z,use_quota=True,user_id='9ae06ff65f0d41ed8476af83fb75991c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8b1016-3647-42c7-8a7a-19153cb7df26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8b1016-3647-42c7-8a7a-19153cb7df26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127edc80-a42a-4e02-a8fb-a3c964aee9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127edc80-a42a-4e02-a8fb-a3c964aee9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb6f308-6362-4054-ab0d-7145c6c99244', 'volume_name': 'volume-afb6f308-6362-4054-ab0d-7145c6c99244', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e7ebf9-d8d5-4fc7-966a-2d4cbd546afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e7ebf9-d8d5-4fc7-966a-2d4cbd546afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da714ec4-0f02-48f7-bc7e-59e0840a73c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Volume afb6f308-6362-4054-ab0d-7145c6c99244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb6f308-6362-4054-ab0d-7145c6c99244', 'volume_size': 1}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-501520217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb6f308-6362-4054-ab0d-7145c6c99244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1751f018d235430384c77b12f6f53243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:41Z,use_quota=True,user_id='9ae06ff65f0d41ed8476af83fb75991c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Creating volume afb6f308-6362-4054-ab0d-7145c6c99244 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:40 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:40 devstack sudo[98422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244 1073741824
Jun 24 04:17:40 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:40 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63698424-4dc4-4cd9-93b6-308fd331d30c" returned: 0 in 0.820s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Lock "cinder-quobyte-63698424-4dc4-4cd9-93b6-308fd331d30c" released by "delete_volume" :: held 1.927s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Created reservations ['d12e1cf9-2004-43bd-9283-c469857a95ec', 'b978a9a7-d937-4751-94b0-67df1d6e937a', 'f4cc4927-7c08-4027-86f7-72eeb8e63b2d', 'd83042df-5c01-4867-9ba8-b3bf51b90d15'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:41 devstack sudo[98427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:17:41 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:42 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244 1073741824" returned: 0 in 1.277s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:42 devstack sudo[98434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244
Jun 24 04:17:42 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:42 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.100s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=44,cinder:UPDATE=57,cinder:DELETE=8,cinder:INSERT=11 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:17:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Deleted volume successfully.
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Flow 'volume_create_manager' (fc62977b-3a10-4b02-b73b-d88be912a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8035415-375e-40b5-b0f9-3419fb821e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7ea0c5ef-7db4-459e-89c2-4b8827f82d03 tempest-VolumesTransfersV355Test-1485882253 None] Lock "cinder-63698424-4dc4-4cd9-93b6-308fd331d30c-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8035415-375e-40b5-b0f9-3419fb821e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-672258258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700af2f0-efcf-4d2b-b395-fee60647d5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c442ac5133c4042b1428ed351e4b974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:42Z,use_quota=True,user_id='f11e4a60405940feb4b72d12649d20c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781634ea-6321-425b-9576-36a9f21d58db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781634ea-6321-425b-9576-36a9f21d58db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28e7da6-ba7d-4ac7-be3b-f999a515790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28e7da6-ba7d-4ac7-be3b-f999a515790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '700af2f0-efcf-4d2b-b395-fee60647d5a8', 'volume_name': 'volume-700af2f0-efcf-4d2b-b395-fee60647d5a8', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615a8d0e-aeb7-4c78-ab76-02089017e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615a8d0e-aeb7-4c78-ab76-02089017e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966019c1-3df1-486f-8f46-8a549c5ce6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Volume 700af2f0-efcf-4d2b-b395-fee60647d5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-700af2f0-efcf-4d2b-b395-fee60647d5a8', 'volume_size': 1}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:42 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244" returned: 0 in 0.814s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-672258258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=700af2f0-efcf-4d2b-b395-fee60647d5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c442ac5133c4042b1428ed351e4b974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:42Z,use_quota=True,user_id='f11e4a60405940feb4b72d12649d20c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Creating volume 700af2f0-efcf-4d2b-b395-fee60647d5a8 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:17:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:43 devstack sudo[98437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8 1073741824
Jun 24 04:17:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da714ec4-0f02-48f7-bc7e-59e0840a73c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb6f308-6362-4054-ab0d-7145c6c99244', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:43 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e21ca60-104b-4ea0-ae3e-d5430b8869c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Volume volume-afb6f308-6362-4054-ab0d-7145c6c99244 (afb6f308-6362-4054-ab0d-7145c6c99244): created successfully
Jun 24 04:17:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e21ca60-104b-4ea0-ae3e-d5430b8869c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Flow 'volume_create_manager' (b7137c82-bf46-4e88-9bb7-2963a509eb94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c2d1eeb2-ca67-4e38-ac9e-a862f2580774 tempest-AttachVolumeNegativeTest-1227270878 None] Created volume successfully.
Jun 24 04:17:44 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8 1073741824" returned: 0 in 1.077s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:44 devstack sudo[98454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8
Jun 24 04:17:44 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-6663d5da-9b15-4771-a1a4-2d8dc5c3a718 req-fc7aacb8-f531-4782-b46b-823181d152e3 tempest-TaggedAttachmentsTest-616521956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:44 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8" returned: 0 in 0.714s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-6663d5da-9b15-4771-a1a4-2d8dc5c3a718 req-fc7aacb8-f531-4782-b46b-823181d152e3 tempest-TaggedAttachmentsTest-616521956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.478s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966019c1-3df1-486f-8f46-8a549c5ce6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-700af2f0-efcf-4d2b-b395-fee60647d5a8', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592d1442-efeb-44e1-b243-d8fb60a0f973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c213e9-e287-4bf2-8d0b-abe1c3b61827]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-6663d5da-9b15-4771-a1a4-2d8dc5c3a718 req-fc7aacb8-f531-4782-b46b-823181d152e3 tempest-TaggedAttachmentsTest-616521956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Volume volume-700af2f0-efcf-4d2b-b395-fee60647d5a8 (700af2f0-efcf-4d2b-b395-fee60647d5a8): created successfully
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592d1442-efeb-44e1-b243-d8fb60a0f973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Flow 'volume_create_manager' (fc62977b-3a10-4b02-b73b-d88be912a472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0b2d3d63-62cd-4df8-b339-7abd4ea37d03 tempest-VolumesTransfersV355Test-828093863 None] Created volume successfully.
Jun 24 04:17:44 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1
Jun 24 04:17:44 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:45 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-6663d5da-9b15-4771-a1a4-2d8dc5c3a718 req-fc7aacb8-f531-4782-b46b-823181d152e3 tempest-TaggedAttachmentsTest-616521956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1" returned: 0 in 1.003s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-6663d5da-9b15-4771-a1a4-2d8dc5c3a718 req-fc7aacb8-f531-4782-b46b-823181d152e3 tempest-TaggedAttachmentsTest-616521956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.041s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-6663d5da-9b15-4771-a1a4-2d8dc5c3a718 req-fc7aacb8-f531-4782-b46b-823181d152e3 tempest-TaggedAttachmentsTest-616521956 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-eed12df4-4566-4975-b021-cda939bc9ba1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cf2b003-9126-4d69-bcd4-853d1e99170a', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:17:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Acquiring lock "cinder-700af2f0-efcf-4d2b-b395-fee60647d5a8-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Lock "cinder-700af2f0-efcf-4d2b-b395-fee60647d5a8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-6663d5da-9b15-4771-a1a4-2d8dc5c3a718 req-fc7aacb8-f531-4782-b46b-823181d152e3 tempest-TaggedAttachmentsTest-616521956 None] attachment_update completed successfully.
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Acquiring lock "cinder-quobyte-700af2f0-efcf-4d2b-b395-fee60647d5a8" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Lock "cinder-quobyte-700af2f0-efcf-4d2b-b395-fee60647d5a8" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d6624-075e-499d-b5ec-038b9931af43]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:46 devstack sudo[98465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8
Jun 24 04:17:46 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:46 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8" returned: 0 in 0.855s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:46 devstack sudo[98546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8
Jun 24 04:17:46 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b5195400-5018-4f6b-bba9-b51c65761598 req-64a0ff68-d2b0-4cb2-80db-d5b2187ed73a tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b5195400-5018-4f6b-bba9-b51c65761598 req-64a0ff68-d2b0-4cb2-80db-d5b2187ed73a tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e094d2-7d4c-4a1b-93f0-65ccdfcc76df]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:17:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-b5195400-5018-4f6b-bba9-b51c65761598 req-64a0ff68-d2b0-4cb2-80db-d5b2187ed73a tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:47 devstack sudo[98548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244
Jun 24 04:17:47 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:47 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-700af2f0-efcf-4d2b-b395-fee60647d5a8" returned: 0 in 0.745s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Lock "cinder-quobyte-700af2f0-efcf-4d2b-b395-fee60647d5a8" released by "delete_volume" :: held 1.652s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Created reservations ['c2ae5870-e65a-44b3-a32e-d006c2101129', '722eac12-af68-4f88-aaab-c0c3cb512ed4', 'e357232f-98e3-43b9-9056-c73641555764', 'a67a5dab-dba7-467a-ae0c-d06ca50778fd'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:47 devstack sudo[98872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:17:47 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:47 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-b5195400-5018-4f6b-bba9-b51c65761598 req-64a0ff68-d2b0-4cb2-80db-d5b2187ed73a tempest-AttachVolumeNegativeTest-1227270878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244" returned: 0 in 0.990s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-b5195400-5018-4f6b-bba9-b51c65761598 req-64a0ff68-d2b0-4cb2-80db-d5b2187ed73a tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b5195400-5018-4f6b-bba9-b51c65761598 req-64a0ff68-d2b0-4cb2-80db-d5b2187ed73a tempest-AttachVolumeNegativeTest-1227270878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-afb6f308-6362-4054-ab0d-7145c6c99244', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccfcdb27-4280-4ec8-a704-1e37da599525', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:17:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-b5195400-5018-4f6b-bba9-b51c65761598 req-64a0ff68-d2b0-4cb2-80db-d5b2187ed73a tempest-AttachVolumeNegativeTest-1227270878 None] attachment_update completed successfully.
Jun 24 04:17:48 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:48 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:17:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Deleted volume successfully.
Jun 24 04:17:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f55b5b-6a93-4f27-9d84-7cbe88f53141 tempest-VolumesTransfersV355Test-1485882253 None] Lock "cinder-700af2f0-efcf-4d2b-b395-fee60647d5a8-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:17:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-01570a65-6226-4794-b424-a24e3dbe5445 req-3678d0ac-3c18-4cee-a44c-ebb47d28e20f tempest-TaggedAttachmentsTest-616521956 None] Terminate volume connection completed successfully.
Jun 24 04:17:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-01570a65-6226-4794-b424-a24e3dbe5445 req-3678d0ac-3c18-4cee-a44c-ebb47d28e20f tempest-TaggedAttachmentsTest-616521956 None] Deleting attachment 8cf2b003-9126-4d69-bcd4-853d1e99170a. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:17:56 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=58,cinder:UPDATE=80,cinder:INSERT=19,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:17:56 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:17:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Flow 'volume_create_manager' (c2779453-448c-457b-bd08-81e9f6047b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ff8162-74ac-4946-a22d-42717859fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ff8162-74ac-4946-a22d-42717859fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1126578279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aec669a-ead5-4375-82c3-ea11d30935ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05769e3c7f084407a40fe9570d0efabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:57Z,use_quota=True,user_id='989dfdf166e942faaa0187b425f86a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e026dc-c5df-4885-8592-c0506beee325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e026dc-c5df-4885-8592-c0506beee325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d5ecb6-f105-43a6-81a0-2b8ec5b97bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d5ecb6-f105-43a6-81a0-2b8ec5b97bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aec669a-ead5-4375-82c3-ea11d30935ae', 'volume_name': 'volume-6aec669a-ead5-4375-82c3-ea11d30935ae', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3773e01c-54c5-4604-87ae-f71f29a56caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3773e01c-54c5-4604-87ae-f71f29a56caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925ecd60-ce48-4af2-865c-48538088a258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Volume 6aec669a-ead5-4375-82c3-ea11d30935ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aec669a-ead5-4375-82c3-ea11d30935ae', 'volume_size': 1}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1126578279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aec669a-ead5-4375-82c3-ea11d30935ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05769e3c7f084407a40fe9570d0efabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:17:57Z,use_quota=True,user_id='989dfdf166e942faaa0187b425f86a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Creating volume 6aec669a-ead5-4375-82c3-ea11d30935ae {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:17:57 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:17:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:57 devstack sudo[98920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae 1073741824
Jun 24 04:17:57 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:58 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae 1073741824" returned: 0 in 1.226s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:17:58 devstack sudo[98931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae
Jun 24 04:17:58 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:17:59 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root
Jun 24 04:17:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae" returned: 0 in 0.844s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:17:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:17:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:17:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925ecd60-ce48-4af2-865c-48538088a258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aec669a-ead5-4375-82c3-ea11d30935ae', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9524019-bd12-42f6-98d0-bfcae4f35f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:17:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Volume volume-6aec669a-ead5-4375-82c3-ea11d30935ae (6aec669a-ead5-4375-82c3-ea11d30935ae): created successfully
Jun 24 04:17:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9524019-bd12-42f6-98d0-bfcae4f35f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:17:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Flow 'volume_create_manager' (c2779453-448c-457b-bd08-81e9f6047b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:17:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-81d62cee-b1c5-4261-a1da-7b4139994842 tempest-VolumesTransfersV357Test-1627720272 None] Created volume successfully.
Jun 24 04:18:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f41d3009-793b-4a79-86b3-aa35e0ab4459 tempest-VolumesTransfersV357Test-358213376 None] Transfer volume completed successfully.
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:01 devstack sudo[98968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:18:01 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Acquiring lock "cinder-6aec669a-ead5-4375-82c3-ea11d30935ae-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Lock "cinder-6aec669a-ead5-4375-82c3-ea11d30935ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Acquiring lock "cinder-quobyte-6aec669a-ead5-4375-82c3-ea11d30935ae" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Lock "cinder-quobyte-6aec669a-ead5-4375-82c3-ea11d30935ae" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3863b6-9f9f-45d7-8675-b3dca1ad6895]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:02 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae
Jun 24 04:18:02 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:02 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.695s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:18:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:18:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:18:02 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae" returned: 0 in 0.858s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:02 devstack sudo[98980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae
Jun 24 04:18:02 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:03 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-6aec669a-ead5-4375-82c3-ea11d30935ae" returned: 0 in 0.963s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Lock "cinder-quobyte-6aec669a-ead5-4375-82c3-ea11d30935ae" released by "delete_volume" :: held 1.888s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:03 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Created reservations ['70499308-f6a5-4321-8457-1a3c46b8b1b3', '9e5db958-2563-4dab-8bc4-048f91e83759', '68f44e2a-cff5-47d3-88be-4d82cad46637', 'c40e5101-81b0-4e14-9a92-01e89b23b900'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:04 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:18:04 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:05 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.248s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Deleted volume successfully.
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fea6e888-016e-436d-b5c3-c2bb32b15a7c tempest-VolumesTransfersV357Test-274043303 None] Lock "cinder-6aec669a-ead5-4375-82c3-ea11d30935ae-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Flow 'volume_create_manager' (39eb330a-29f8-49f0-8dbe-c74043abe0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396adec4-87e0-4f8b-bfdc-ef78918e8af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396adec4-87e0-4f8b-bfdc-ef78918e8af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1209988408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddfd71f9-84d4-4f48-8572-b98e99d9c965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05769e3c7f084407a40fe9570d0efabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:06Z,use_quota=True,user_id='989dfdf166e942faaa0187b425f86a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb0ff89-3c79-4497-b355-fd2528ef766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb0ff89-3c79-4497-b355-fd2528ef766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4afb83-423a-4173-8412-4bec6a958010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4afb83-423a-4173-8412-4bec6a958010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddfd71f9-84d4-4f48-8572-b98e99d9c965', 'volume_name': 'volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b139d610-36ea-440c-bdf3-363a802bc1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b139d610-36ea-440c-bdf3-363a802bc1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388c3d86-10b8-4153-b687-8112e2957a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Volume ddfd71f9-84d4-4f48-8572-b98e99d9c965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965', 'volume_size': 1}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1209988408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddfd71f9-84d4-4f48-8572-b98e99d9c965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05769e3c7f084407a40fe9570d0efabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:06Z,use_quota=True,user_id='989dfdf166e942faaa0187b425f86a38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Creating volume ddfd71f9-84d4-4f48-8572-b98e99d9c965 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:18:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:05 devstack sudo[99149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965 1073741824
Jun 24 04:18:05 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:07 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965 1073741824" returned: 0 in 1.287s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:07 devstack sudo[99185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965
Jun 24 04:18:07 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:08 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965" returned: 0 in 0.987s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388c3d86-10b8-4153-b687-8112e2957a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4eee14-7da5-47c1-95b0-b8ef280365fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Volume volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965 (ddfd71f9-84d4-4f48-8572-b98e99d9c965): created successfully
Jun 24 04:18:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4eee14-7da5-47c1-95b0-b8ef280365fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Flow 'volume_create_manager' (39eb330a-29f8-49f0-8dbe-c74043abe0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-334c1d8b-3724-4578-b994-38dff8184dd8 tempest-VolumesTransfersV357Test-1627720272 None] Created volume successfully.
Jun 24 04:18:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Acquiring lock "cinder-ddfd71f9-84d4-4f48-8572-b98e99d9c965-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Lock "cinder-ddfd71f9-84d4-4f48-8572-b98e99d9c965-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Acquiring lock "cinder-quobyte-ddfd71f9-84d4-4f48-8572-b98e99d9c965" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Lock "cinder-quobyte-ddfd71f9-84d4-4f48-8572-b98e99d9c965" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc33662-01d6-4791-9c5d-30a6186715e7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:09 devstack sudo[99190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965
Jun 24 04:18:09 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:10 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965" returned: 0 in 1.175s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:10 devstack sudo[99199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965
Jun 24 04:18:10 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Flow 'volume_create_manager' (a9902804-b430-463b-a985-36257ea826fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f34f71-ffd4-4db6-accf-9c991077b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f34f71-ffd4-4db6-accf-9c991077b08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2035101509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045870fc-d514-4d60-99ee-d59f80872e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a580ff2743644784b31ae38b9f5f82d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:11Z,use_quota=True,user_id='3801683042eb40ababd1d56eea3f8f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5948796-1075-4984-8137-4d46cfbde4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5948796-1075-4984-8137-4d46cfbde4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6075257b-ca1a-4b75-8ade-7e54884bdd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6075257b-ca1a-4b75-8ade-7e54884bdd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045870fc-d514-4d60-99ee-d59f80872e09', 'volume_name': 'volume-045870fc-d514-4d60-99ee-d59f80872e09', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bb5967-e11f-460a-842e-c86713026e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bb5967-e11f-460a-842e-c86713026e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168def57-aa97-4b73-a668-cf42dafea3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:11 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Volume 045870fc-d514-4d60-99ee-d59f80872e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045870fc-d514-4d60-99ee-d59f80872e09', 'volume_size': 1}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2035101509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045870fc-d514-4d60-99ee-d59f80872e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a580ff2743644784b31ae38b9f5f82d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:11Z,use_quota=True,user_id='3801683042eb40ababd1d56eea3f8f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Creating volume 045870fc-d514-4d60-99ee-d59f80872e09 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:11 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:11 devstack sudo[99202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09 1073741824
Jun 24 04:18:11 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:11 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ddfd71f9-84d4-4f48-8572-b98e99d9c965" returned: 0 in 0.798s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Lock "cinder-quobyte-ddfd71f9-84d4-4f48-8572-b98e99d9c965" released by "delete_volume" :: held 2.053s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Created reservations ['4ac4924e-6036-4edf-a275-f9d1620a6961', '30ce0721-1a7a-4b62-ad1a-247ecae0c26d', '0c16cbb1-c83f-4b9d-ade0-838c9a7e3506', 'eb75f34a-5cd2-4110-9fd6-8d7d651ead58'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:11 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:18:11 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:12 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09 1073741824" returned: 0 in 1.811s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:12 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.537s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:13 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Deleted volume successfully.
Jun 24 04:18:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:13 devstack sudo[99234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09
Jun 24 04:18:13 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6b112472-1eab-4a8b-98cf-7b857c2f4e23 tempest-VolumesTransfersV357Test-274043303 None] Lock "cinder-ddfd71f9-84d4-4f48-8572-b98e99d9c965-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:14 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09" returned: 0 in 1.653s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] <== create_volume: return (3570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.573s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168def57-aa97-4b73-a668-cf42dafea3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045870fc-d514-4d60-99ee-d59f80872e09', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d2dbfc-8700-4afa-a1b4-2a1fb1c8bb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Volume volume-045870fc-d514-4d60-99ee-d59f80872e09 (045870fc-d514-4d60-99ee-d59f80872e09): created successfully
Jun 24 04:18:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d2dbfc-8700-4afa-a1b4-2a1fb1c8bb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Flow 'volume_create_manager' (a9902804-b430-463b-a985-36257ea826fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-60adfbaa-3123-46d9-ae38-5ed959b7ad1f tempest-TestMinimumBasicScenario-1626692457 None] Created volume successfully.
Jun 24 04:18:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Acquiring lock "cinder-eed12df4-4566-4975-b021-cda939bc9ba1-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Lock "cinder-eed12df4-4566-4975-b021-cda939bc9ba1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Acquiring lock "cinder-quobyte-eed12df4-4566-4975-b021-cda939bc9ba1" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Lock "cinder-quobyte-eed12df4-4566-4975-b021-cda939bc9ba1" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[47239929-4244-43b8-9bcf-d845e074e22a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:17 devstack sudo[99275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1
Jun 24 04:18:17 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:18 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1" returned: 0 in 1.471s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:18 devstack sudo[99281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1
Jun 24 04:18:18 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:19 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-eed12df4-4566-4975-b021-cda939bc9ba1" returned: 0 in 1.664s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Lock "cinder-quobyte-eed12df4-4566-4975-b021-cda939bc9ba1" released by "delete_volume" :: held 3.207s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Created reservations ['822c82d7-5e86-43a6-83ca-ba36e84150e4', '64bca598-0505-4357-9f86-9428575e2112', 'ec3d4b8a-ec94-4972-a8c8-70027cf85e2c', 'e18594d7-0c5a-4266-b0a4-32e372890aa6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-9b7d7b51-a943-48b5-b6d3-4a36f3d3bf0d req-4ac3c0f0-29bf-48e9-80d8-fa367c217727 tempest-TestMinimumBasicScenario-1626692457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-9b7d7b51-a943-48b5-b6d3-4a36f3d3bf0d req-4ac3c0f0-29bf-48e9-80d8-fa367c217727 tempest-TestMinimumBasicScenario-1626692457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87efc3e-9940-4560-a4ef-a48e7648d497]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-9b7d7b51-a943-48b5-b6d3-4a36f3d3bf0d req-4ac3c0f0-29bf-48e9-80d8-fa367c217727 tempest-TestMinimumBasicScenario-1626692457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:20 devstack sudo[99318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:18:20 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:20 devstack sudo[99317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09
Jun 24 04:18:20 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:21 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.894s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Deleted volume successfully.
Jun 24 04:18:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4d0d0b2-ae1f-4a7e-967a-7f1cb264e152 tempest-TaggedAttachmentsTest-616521956 None] Lock "cinder-eed12df4-4566-4975-b021-cda939bc9ba1-delete_volume" released by "delete_volume" :: held 4.542s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:21 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-9b7d7b51-a943-48b5-b6d3-4a36f3d3bf0d req-4ac3c0f0-29bf-48e9-80d8-fa367c217727 tempest-TestMinimumBasicScenario-1626692457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09" returned: 0 in 1.050s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-9b7d7b51-a943-48b5-b6d3-4a36f3d3bf0d req-4ac3c0f0-29bf-48e9-80d8-fa367c217727 tempest-TestMinimumBasicScenario-1626692457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-9b7d7b51-a943-48b5-b6d3-4a36f3d3bf0d req-4ac3c0f0-29bf-48e9-80d8-fa367c217727 tempest-TestMinimumBasicScenario-1626692457 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-045870fc-d514-4d60-99ee-d59f80872e09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8f86eaf-82a4-4a92-a055-0650bf7a1d44', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:18:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-9b7d7b51-a943-48b5-b6d3-4a36f3d3bf0d req-4ac3c0f0-29bf-48e9-80d8-fa367c217727 tempest-TestMinimumBasicScenario-1626692457 None] attachment_update completed successfully.
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Flow 'volume_create_manager' (e7dbe1e3-7f40-4779-b523-2e0dd5e7a7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275fa3e6-c5c6-402f-9496-16087b06f1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275fa3e6-c5c6-402f-9496-16087b06f1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2006072917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89e2e7b-7a8f-47b6-96ed-e92d114fd92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a929d7f38948efae602fbcc53ab152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:23Z,use_quota=True,user_id='b6575973afc240cd80b1eab87db8ed61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e9ee15-d05b-450a-b60c-47c63b10a8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e9ee15-d05b-450a-b60c-47c63b10a8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef8703e-f2e4-47cd-91a5-ee4d49fc4a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef8703e-f2e4-47cd-91a5-ee4d49fc4a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e89e2e7b-7a8f-47b6-96ed-e92d114fd92b', 'volume_name': 'volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f098ad50>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf03569d-24c2-4ba5-aee5-0c996e377daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf03569d-24c2-4ba5-aee5-0c996e377daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd2ee6e-bb5f-4e0c-a2e6-8f0f810964ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:23 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Volume e89e2e7b-7a8f-47b6-96ed-e92d114fd92b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f098ad50>}
Jun 24 04:18:23 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Trying to clone e89e2e7b-7a8f-47b6-96ed-e92d114fd92b from image d16527e6-13ec-4d21-b5b6-0410252234f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:18:24 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:18:24 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Image download 20.69 MB at 20.69 MB/s
Jun 24 04:18:24 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c647ab3-0a2f-4733-aad9-b79b3e587e54]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:24 devstack sudo[99335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD
Jun 24 04:18:24 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:25 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD" returned: 0 in 1.217s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:25 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Temporary image d16527e6-13ec-4d21-b5b6-0410252234f4 is fetched for user b6575973afc240cd80b1eab87db8ed61. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:18:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[487002da-b20d-4d71-8fe9-fd73386a033b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:25 devstack sudo[99362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD
Jun 24 04:18:25 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:27 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD" returned: 0 in 1.607s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2006072917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89e2e7b-7a8f-47b6-96ed-e92d114fd92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a929d7f38948efae602fbcc53ab152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:23Z,use_quota=True,user_id='b6575973afc240cd80b1eab87db8ed61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Creating volume e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:27 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:18:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:27 devstack sudo[99375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b 1073741824
Jun 24 04:18:27 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:28 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b 1073741824" returned: 0 in 1.590s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:28 devstack sudo[99387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:28 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:29 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 0 in 1.088s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] <== create_volume: return (2745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.749s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:29 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Attempting download of d16527e6-13ec-4d21-b5b6-0410252234f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}])) to volume e89e2e7b-7a8f-47b6-96ed-e92d114fd92b. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:18:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[165a2611-97d8-49d5-8a25-55ebcc3bf454]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_zh6jntdv {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:30 devstack sudo[99394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_zh6jntdv
Jun 24 04:18:30 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:31 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_zh6jntdv" returned: 0 in 1.037s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_zh6jntdv {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:31 devstack sudo[99418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_zh6jntdv
Jun 24 04:18:31 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:31 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_zh6jntdv" returned: 1 in 0.882s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_zh6jntdv' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:18:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde11c9-4211-451b-b536-8598507302de]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:32 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD
Jun 24 04:18:32 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:32 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD" returned: 0 in 0.931s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:32 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] d16527e6-13ec-4d21-b5b6-0410252234f4 was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:18:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:32 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:32 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:35 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 0 in 2.454s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:35 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_as_ty4a7devstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:18:35 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Converted 112.00 MB image at 45.62 MB/s
Jun 24 04:18:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:35 devstack sudo[99444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b 1G
Jun 24 04:18:35 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:36 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b 1G" returned: 0 in 0.794s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[999bc2c7-c7c7-4841-b808-312830f19485]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:36 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:36 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:37 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 0 in 0.957s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:37 devstack sudo[99454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:37 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:38 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 1 in 0.896s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Downloaded image d16527e6-13ec-4d21-b5b6-0410252234f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}])) to volume e89e2e7b-7a8f-47b6-96ed-e92d114fd92b successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Temporary image d16527e6-13ec-4d21-b5b6-0410252234f4 for user b6575973afc240cd80b1eab87db8ed61 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Marking volume e89e2e7b-7a8f-47b6-96ed-e92d114fd92b as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Copying metadata from image d16527e6-13ec-4d21-b5b6-0410252234f4 to e89e2e7b-7a8f-47b6-96ed-e92d114fd92b. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Creating volume glance metadata for volume e89e2e7b-7a8f-47b6-96ed-e92d114fd92b backed by image d16527e6-13ec-4d21-b5b6-0410252234f4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd2ee6e-bb5f-4e0c-a2e6-8f0f810964ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f098ad50>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4295abb-ee97-4490-b51a-9b076beb6941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Volume volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b (e89e2e7b-7a8f-47b6-96ed-e92d114fd92b): created successfully
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4295abb-ee97-4490-b51a-9b076beb6941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Flow 'volume_create_manager' (e7dbe1e3-7f40-4779-b523-2e0dd5e7a7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d69c1395-8afc-49ec-972d-671c35204e2e tempest-VolumesExtendTest-1360739974 None] Created volume successfully.
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6656b058-1911-4932-b8e1-65c29b3926c2]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:38 devstack sudo[99509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:38 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:39 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 0 in 0.826s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:39 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:39 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:40 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 1 in 0.826s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:18:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b 2G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b 2G" returned: 0 in 0.097s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.838s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e435f864-ee33-46c2-95d1-552e00953312 tempest-VolumesExtendTest-1360739974 None] Extend volume completed successfully.
Jun 24 04:18:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Acquiring lock "cinder-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Acquiring lock "cinder-quobyte-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-quobyte-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05a766-80c0-4751-b0c7-1dbddb3c4cfd]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:41 devstack sudo[99524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:41 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:42 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 0 in 1.149s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:42 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:42 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:43 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 1 in 0.931s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:18:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:43 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b
Jun 24 04:18:43 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:44 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" returned: 0 in 0.762s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-quobyte-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b" released by "delete_volume" :: held 2.920s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=60,cinder:DELETE=4,cinder:SELECT=57,cinder:INSERT=14 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Created reservations ['db593506-9245-49e6-bff1-474b6586e16c', '36f16cf9-c1f0-400d-a1f6-8be05eb69bf6', '1a16c75b-b3ae-4fa1-b82c-77e73b29a868', '0991730e-266b-498d-a03c-507f045af6ca'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:44 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:18:44 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:45 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.869s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:18:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Deleted volume successfully.
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c75986c-1bd4-4a17-a62b-b4384eecd896 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-e89e2e7b-7a8f-47b6-96ed-e92d114fd92b-delete_volume" released by "delete_volume" :: held 4.169s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Flow 'volume_create_manager' (ad323cd5-3cce-4fca-ba5e-028e3c34226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0751a81-a3d4-4d4f-bf2d-dbf759c043ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0751a81-a3d4-4d4f-bf2d-dbf759c043ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-216115959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df1e7d6-0bfa-4bb1-abe8-e78430e291df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a929d7f38948efae602fbcc53ab152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:46Z,use_quota=True,user_id='b6575973afc240cd80b1eab87db8ed61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5aae67-4db1-4fee-b706-42fa377541af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5aae67-4db1-4fee-b706-42fa377541af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a38f009-7c2c-4510-9f5e-a00016578fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a38f009-7c2c-4510-9f5e-a00016578fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df1e7d6-0bfa-4bb1-abe8-e78430e291df', 'volume_name': 'volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c9b6f0-8366-4a9e-b14c-7c448c87b51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c9b6f0-8366-4a9e-b14c-7c448c87b51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc69770-0693-4101-ae1f-694a894324d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Volume 0df1e7d6-0bfa-4bb1-abe8-e78430e291df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df', 'volume_size': 1}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-216115959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df1e7d6-0bfa-4bb1-abe8-e78430e291df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a929d7f38948efae602fbcc53ab152',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:18:46Z,use_quota=True,user_id='b6575973afc240cd80b1eab87db8ed61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Creating volume 0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:18:45 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:18:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:46 devstack sudo[99619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df 1073741824
Jun 24 04:18:46 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:47 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df 1073741824" returned: 0 in 1.096s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:47 devstack sudo[99650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df
Jun 24 04:18:47 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:48 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" returned: 0 in 1.021s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:18:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc69770-0693-4101-ae1f-694a894324d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ae5d52-ae7f-4d50-9fd1-170211926e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:18:48 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Volume volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df (0df1e7d6-0bfa-4bb1-abe8-e78430e291df): created successfully
Jun 24 04:18:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ae5d52-ae7f-4d50-9fd1-170211926e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:18:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Flow 'volume_create_manager' (ad323cd5-3cce-4fca-ba5e-028e3c34226e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:18:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7e9114b3-a069-4fd8-805e-17dec639c14d tempest-VolumesExtendTest-1360739974 None] Created volume successfully.
Jun 24 04:18:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Creating offline snapshot 84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef of volume 0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:18:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d431603b-a5ec-438a-993e-340af108cfe9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:49 devstack sudo[99705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df
Jun 24 04:18:49 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:50 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:50 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef 1G
Jun 24 04:18:50 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:51 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef 1G" returned: 0 in 1.325s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:51 devstack sudo[99718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef
Jun 24 04:18:51 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:52 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef" returned: 0 in 1.009s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:52 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef is being set with open permissions: ugo+rw
Jun 24 04:18:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:52 devstack sudo[99725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef
Jun 24 04:18:52 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:53 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef" returned: 0 in 0.943s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:53 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.info
Jun 24 04:18:53 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-22ddac18-5f05-45ea-ad0d-f3adee08142f req-60ec04aa-3831-463d-9250-f01f00a3d0b8 tempest-AttachVolumeNegativeTest-1227270878 None] Terminate volume connection completed successfully.
Jun 24 04:18:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-22ddac18-5f05-45ea-ad0d-f3adee08142f req-60ec04aa-3831-463d-9250-f01f00a3d0b8 tempest-AttachVolumeNegativeTest-1227270878 None] Deleting attachment ccfcdb27-4280-4ec8-a704-1e37da599525. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:18:54 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.info" returned: 0 in 0.963s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:54 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.info is being set with open permissions: ugo+rw
Jun 24 04:18:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:54 devstack sudo[99744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.info
Jun 24 04:18:54 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:55 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.info" returned: 0 in 0.776s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.217s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3f4cf93c-672a-47b2-8e5d-5c86ff0a84bc tempest-VolumesExtendTest-1360739974 None] Create snapshot completed successfully
Jun 24 04:18:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7eadffab-c176-4fb6-a4e8-776911e21e47 tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:18:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7eadffab-c176-4fb6-a4e8-776911e21e47 tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:18:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b2b995-e8bf-4c4b-9d8c-5fba825e6878]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7eadffab-c176-4fb6-a4e8-776911e21e47 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:55 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df
Jun 24 04:18:55 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:56 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7eadffab-c176-4fb6-a4e8-776911e21e47 tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" returned: 0 in 0.922s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7eadffab-c176-4fb6-a4e8-776911e21e47 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef 2G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7eadffab-c176-4fb6-a4e8-776911e21e47 tempest-VolumesExtendTest-1360739974 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef 2G" returned: 0 in 0.128s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7eadffab-c176-4fb6-a4e8-776911e21e47 tempest-VolumesExtendTest-1360739974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.091s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:18:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7eadffab-c176-4fb6-a4e8-776911e21e47 tempest-VolumesExtendTest-1360739974 None] Extend volume completed successfully.
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Acquiring lock "cinder-84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Acquiring lock "cinder-quobyte-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-quobyte-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Acquiring lock "cinder-quobyte-84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-quobyte-84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Deleting offline snapshot 84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef of volume 0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] snapshot_file for this snap is: volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd02f68b-911c-4156-992c-bbe3025f71ce]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:58 devstack sudo[99797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef
Jun 24 04:18:58 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:18:59 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root
Jun 24 04:18:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef" returned: 0 in 0.905s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:18:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:18:59 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bd78ef-d1a2-4f5a-8c4e-3102aeba1c14]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:18:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:18:59 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df
Jun 24 04:18:59 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:00 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" returned: 0 in 1.389s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:00 devstack sudo[99811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef
Jun 24 04:19:00 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:01 devstack sudo[99836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:19:01 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:01 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef" returned: 0 in 1.322s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:02 devstack sudo[99839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef
Jun 24 04:19:02 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:02 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.812s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:19:02 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df.84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef" returned: 0 in 0.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=51,cinder:INSERT=19,cinder:DELETE=7,cinder:SELECT=54 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-quobyte-84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef" released by "_delete_snapshot" :: held 4.451s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-quobyte-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" released by "delete_snapshot" :: held 4.479s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Created reservations ['c80fc819-98b7-4c34-8153-d1e9364508cf', 'd6eb28b3-9a85-423c-9e85-d0e91f7564fb', '763378f0-5f0c-4765-a204-599df6175b07', '30beeb01-2c3f-4aff-baf9-774bb9947444'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Delete snapshot completed successfully.
Jun 24 04:19:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8c5aca3f-44be-4be3-8d39-63bcdeae58c0 tempest-VolumesExtendTest-1360739974 None] Lock "cinder-84bb0d2f-e72f-4bb6-9ca7-ab1e80a8f1ef-delete_snapshot" released by "delete_snapshot" :: held 4.635s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Acquiring lock "cinder-0df1e7d6-0bfa-4bb1-abe8-e78430e291df-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Lock "cinder-0df1e7d6-0bfa-4bb1-abe8-e78430e291df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Acquiring lock "cinder-quobyte-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Lock "cinder-quobyte-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[990d416d-d529-47ec-a60f-7f98b83ad235]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:03 devstack sudo[99843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df
Jun 24 04:19:03 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:04 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" returned: 0 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:04 devstack sudo[99850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df
Jun 24 04:19:04 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:05 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" returned: 0 in 0.659s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Lock "cinder-quobyte-0df1e7d6-0bfa-4bb1-abe8-e78430e291df" released by "delete_volume" :: held 1.511s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Created reservations ['042ed1ee-dfda-4fb1-8dfe-bf63f331a013', '3903fd35-c48f-4565-9f6f-8ca1e37c328d', 'b0dfc9f3-83ac-4b7a-b49c-e8e7703cd7ac', '68337c74-6728-4f3e-8492-710c5a4d64f8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:05 devstack sudo[99857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:19:05 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:06 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.743s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Deleted volume successfully.
Jun 24 04:19:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b815384e-02e5-47df-8b92-7e09d7d36ccf tempest-VolumesExtendTest-1360739974 None] Lock "cinder-0df1e7d6-0bfa-4bb1-abe8-e78430e291df-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (35f6bb2c-0910-481f-83db-bf9967b279d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02511139-eeea-4426-aef7-cfa3629af858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02511139-eeea-4426-aef7-cfa3629af858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-675623984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabd256a-f6ec-4b9a-8c42-c63cbb34266c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:11Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c41221f-371d-4c38-8c34-d990a48f22bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c41221f-371d-4c38-8c34-d990a48f22bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71150622-8f6e-43e4-82be-d5deb6257053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71150622-8f6e-43e4-82be-d5deb6257053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabd256a-f6ec-4b9a-8c42-c63cbb34266c', 'volume_name': 'volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcd46ac-3eb3-4051-9aa4-af839543e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcd46ac-3eb3-4051-9aa4-af839543e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f87ce0-3c18-4d67-ab8d-fd144de5e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:11 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Volume fabd256a-f6ec-4b9a-8c42-c63cbb34266c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c', 'volume_size': 1}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-675623984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabd256a-f6ec-4b9a-8c42-c63cbb34266c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:11Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Creating volume fabd256a-f6ec-4b9a-8c42-c63cbb34266c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:11 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:19:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:11 devstack sudo[99947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c 1073741824
Jun 24 04:19:11 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:12 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c 1073741824" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:12 devstack sudo[99958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c
Jun 24 04:19:12 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:13 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c" returned: 0 in 1.133s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.215s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f87ce0-3c18-4d67-ab8d-fd144de5e919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8834c08b-bff5-4d22-b79b-d2aaca57dc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:13 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Volume volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c (fabd256a-f6ec-4b9a-8c42-c63cbb34266c): created successfully
Jun 24 04:19:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8834c08b-bff5-4d22-b79b-d2aaca57dc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (35f6bb2c-0910-481f-83db-bf9967b279d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5730f109-699c-441e-8d19-b7ad33542c12 tempest-VolumesGetTest-1474065055 None] Created volume successfully.
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (b5b40ab2-05da-4ad2-8ba6-d4fd951f9fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8752570a-7364-4641-b7ed-b771b364c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8752570a-7364-4641-b7ed-b771b364c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-630267575',display_name='tempest-VolumesGetTest-Volume-517396882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6385afc-c72e-48b2-b7b7-7a7e868ae3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:16Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041f7f77-5d3b-4715-aa28-2d36fb74dedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041f7f77-5d3b-4715-aa28-2d36fb74dedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4ad5d8-2439-49f5-87aa-577a270f86c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4ad5d8-2439-49f5-87aa-577a270f86c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6385afc-c72e-48b2-b7b7-7a7e868ae3dd', 'volume_name': 'volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093c0998-c069-47c5-9a9f-246136c4154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093c0998-c069-47c5-9a9f-246136c4154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f9be7d-88cb-4775-b1bc-c684c37147ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Volume f6385afc-c72e-48b2-b7b7-7a7e868ae3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd', 'volume_size': 1}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-630267575',display_name='tempest-VolumesGetTest-Volume-517396882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6385afc-c72e-48b2-b7b7-7a7e868ae3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:16Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Creating volume f6385afc-c72e-48b2-b7b7-7a7e868ae3dd {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:16 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:19:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:16 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd 1073741824
Jun 24 04:19:16 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-287bfd5b-a7fa-4cca-b857-bea3a49660db req-1bb87389-15ba-4973-a5f7-ef7fd3c93b32 tempest-TestMinimumBasicScenario-1626692457 None] Terminate volume connection completed successfully.
Jun 24 04:19:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-287bfd5b-a7fa-4cca-b857-bea3a49660db req-1bb87389-15ba-4973-a5f7-ef7fd3c93b32 tempest-TestMinimumBasicScenario-1626692457 None] Deleting attachment d8f86eaf-82a4-4a92-a055-0650bf7a1d44. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:19:17 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd 1073741824" returned: 0 in 1.597s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:17 devstack sudo[99995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd
Jun 24 04:19:17 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd" returned: 0 in 1.045s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] <== create_volume: return (2754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.757s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:18 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f9be7d-88cb-4775-b1bc-c684c37147ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0af94a4-06fb-4e71-b61d-9e57da4c7c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:19 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Volume volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd (f6385afc-c72e-48b2-b7b7-7a7e868ae3dd): created successfully
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0af94a4-06fb-4e71-b61d-9e57da4c7c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (b5b40ab2-05da-4ad2-8ba6-d4fd951f9fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2507fedb-336b-4018-9488-254e846beff0 tempest-VolumesGetTest-1474065055 None] Created volume successfully.
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Acquiring lock "cinder-045870fc-d514-4d60-99ee-d59f80872e09-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Lock "cinder-045870fc-d514-4d60-99ee-d59f80872e09-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Acquiring lock "cinder-quobyte-045870fc-d514-4d60-99ee-d59f80872e09" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Lock "cinder-quobyte-045870fc-d514-4d60-99ee-d59f80872e09" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b2a1b8-ac84-4e75-8768-166d38030066]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Lock "cinder-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:19 devstack sudo[100002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09
Jun 24 04:19:19 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[731fb5dc-48a9-4257-af67-799b7bbe61cc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:19 devstack sudo[100004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd
Jun 24 04:19:19 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:20 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09" returned: 0 in 1.010s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:20 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:20 devstack sudo[100013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09
Jun 24 04:19:20 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd" returned: 0 in 0.881s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:20 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd
Jun 24 04:19:20 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:21 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-045870fc-d514-4d60-99ee-d59f80872e09" returned: 0 in 0.726s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:21 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd" returned: 0 in 0.683s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Lock "cinder-quobyte-045870fc-d514-4d60-99ee-d59f80872e09" released by "delete_volume" :: held 1.793s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd" released by "delete_volume" :: held 1.618s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Created reservations ['31d85d68-d7ba-47b3-87b8-a92aa076d9a3', 'c4342343-5d0a-4ab5-bc0b-194e5de1811f', '1a9ec9d9-07e8-4b78-8add-f87badc2d4df', '146077d9-4c2f-444b-8165-611c6153163e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Created reservations ['af073b97-31fc-416a-9524-24a209becd51', 'dedd0663-e2d0-4806-ab95-8db3dced5ce7', '708fb62f-f708-43c1-9e02-a76191852cf4', '06edf2a6-a9d1-4ab5-9cee-e34b08116a3c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:21 devstack sudo[100019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:19:21 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:21 devstack sudo[100021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:19:21 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-fabd256a-f6ec-4b9a-8c42-c63cbb34266c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Lock "cinder-fabd256a-f6ec-4b9a-8c42-c63cbb34266c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-fabd256a-f6ec-4b9a-8c42-c63cbb34266c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-fabd256a-f6ec-4b9a-8c42-c63cbb34266c" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8931c1ba-ccdd-4774-867c-64afcb902609]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:22 devstack sudo[100038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c
Jun 24 04:19:22 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:22 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.025s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Deleted volume successfully.
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0e16221b-6da2-4dc5-b663-5b8d3cdcf678 tempest-TestMinimumBasicScenario-1626692457 None] Lock "cinder-045870fc-d514-4d60-99ee-d59f80872e09-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:22 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.095s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Deleted volume successfully.
Jun 24 04:19:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9669755d-215e-4748-9ef2-24e43148113d tempest-VolumesGetTest-1474065055 None] Lock "cinder-f6385afc-c72e-48b2-b7b7-7a7e868ae3dd-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:23 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c" returned: 0 in 1.074s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:23 devstack sudo[100083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c
Jun 24 04:19:23 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:23 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fabd256a-f6ec-4b9a-8c42-c63cbb34266c" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-fabd256a-f6ec-4b9a-8c42-c63cbb34266c" released by "delete_volume" :: held 1.905s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Created reservations ['9f095f7f-8d0a-416c-a536-d6b711cde7a8', 'a6f47612-b7b5-4adf-94c0-08d853c0d87e', '2e5f5343-191e-42c5-9d9f-eb04cc3e0911', '50ad2c4c-c662-42cf-b8f3-bf17522c40a5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:24 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:19:24 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (60a463ba-d463-492f-8489-4fd446bfea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:24 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac9c456-5854-4855-8aa3-56a20f360cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.850s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:19:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Deleted volume successfully.
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac9c456-5854-4855-8aa3-56a20f360cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1012548457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0e4f5b-4f19-40c6-ad09-122fdb4abf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:25Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ab386a-fbb8-410b-8c99-a43adf6df2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ab386a-fbb8-410b-8c99-a43adf6df2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59fad7d-0118-475a-bc4f-c9fbf760ec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59fad7d-0118-475a-bc4f-c9fbf760ec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0e4f5b-4f19-40c6-ad09-122fdb4abf71', 'volume_name': 'volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6031d9f-219b-4d00-9d7d-b9718e8cfd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6031d9f-219b-4d00-9d7d-b9718e8cfd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b330c32-e1b3-4a3b-b691-e0b969e6ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:25 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Volume 4b0e4f5b-4f19-40c6-ad09-122fdb4abf71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71', 'volume_size': 1}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1012548457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0e4f5b-4f19-40c6-ad09-122fdb4abf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:25Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Creating volume 4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:25 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1680d096-5e28-40c9-9934-4fc6905bd7f9 tempest-VolumesGetTest-1474065055 None] Lock "cinder-fabd256a-f6ec-4b9a-8c42-c63cbb34266c-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:25 devstack sudo[100127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 1073741824
Jun 24 04:19:25 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:26 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 1073741824" returned: 0 in 1.413s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:26 devstack sudo[100205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71
Jun 24 04:19:26 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:27 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" returned: 0 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.269s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b330c32-e1b3-4a3b-b691-e0b969e6ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31e621f-7894-446d-a0e6-92b87dccaa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:27 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Volume volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 (4b0e4f5b-4f19-40c6-ad09-122fdb4abf71): created successfully
Jun 24 04:19:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31e621f-7894-446d-a0e6-92b87dccaa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (60a463ba-d463-492f-8489-4fd446bfea2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7e6c5e94-d2c3-4a2d-9a72-0dcd952580bc tempest-VolumesGetTest-1474065055 None] Created volume successfully.
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (8d63f88e-c52b-4296-88e1-8a827a245458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f749725-c1a9-4369-8735-c38e999ba4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f749725-c1a9-4369-8735-c38e999ba4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1672372760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2760b8a8-73df-427d-a00d-30d55f92a0b6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=4b0e4f5b-4f19-40c6-ad09-122fdb4abf71,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:29Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273daf10-fa3a-4776-952c-44de7f0a7f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273daf10-fa3a-4776-952c-44de7f0a7f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464d9ebc-6f9c-443c-a71c-f2ace2fd2dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464d9ebc-6f9c-443c-a71c-f2ace2fd2dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2760b8a8-73df-427d-a00d-30d55f92a0b6', 'volume_name': 'volume-2760b8a8-73df-427d-a00d-30d55f92a0b6', 'volume_size': 1, 'source_volid': '4b0e4f5b-4f19-40c6-ad09-122fdb4abf71', 'source_volstatus': 'available'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd26442c-5295-41a3-bded-1df98f33c8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd26442c-5295-41a3-bded-1df98f33c8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a502d4-3eaf-4cb9-8d61-e0dcca96e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Volume 2760b8a8-73df-427d-a00d-30d55f92a0b6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2760b8a8-73df-427d-a00d-30d55f92a0b6', 'volume_size': 1, 'source_volid': '4b0e4f5b-4f19-40c6-ad09-122fdb4abf71', 'source_volstatus': 'available'}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:28 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Cloning volume 4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 to volume 2760b8a8-73df-427d-a00d-30d55f92a0b6
Jun 24 04:19:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Creating offline snapshot 937216d9-2836-444e-9f01-4063c1209d88 of volume 4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:19:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1986cf2f-a287-413e-ad39-41e23d64b4c1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:29 devstack sudo[100226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71
Jun 24 04:19:29 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:30 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" returned: 0 in 1.083s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:30 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 1G
Jun 24 04:19:30 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:31 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 1G" returned: 0 in 1.334s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:31 devstack sudo[100241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88
Jun 24 04:19:31 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:32 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88" returned: 0 in 0.916s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:32 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 is being set with open permissions: ugo+rw
Jun 24 04:19:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:32 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88
Jun 24 04:19:32 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:33 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88" returned: 0 in 0.805s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:33 devstack sudo[100254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.info
Jun 24 04:19:33 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:33 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.info" returned: 0 in 0.722s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:33 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.info is being set with open permissions: ugo+rw
Jun 24 04:19:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:33 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.info
Jun 24 04:19:33 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:35 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.info" returned: 0 in 1.151s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-2760b8a8-73df-427d-a00d-30d55f92a0b6" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-2760b8a8-73df-427d-a00d-30d55f92a0b6" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] snapshot: 937216d9-2836-444e-9f01-4063c1209d88, volume: 2760b8a8-73df-427d-a00d-30d55f92a0b6,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38b4e54-12ce-443e-a357-a72d10e23eca]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:35 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88
Jun 24 04:19:35 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Flow 'volume_create_manager' (6122cbae-77fe-47c2-a475-ec4a0170b4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d207b28c-4be8-4e81-90ea-3de4fa00f908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d207b28c-4be8-4e81-90ea-3de4fa00f908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1471432731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbeae58b-ec85-4403-8a48-58e081e82a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cbd8564cc74c89befafe1a5d2adf7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:35Z,use_quota=True,user_id='cad46b54e9384f4fb130dcf57721801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d1b5ff-483f-4ea2-b58c-5542ae2bd51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d1b5ff-483f-4ea2-b58c-5542ae2bd51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8840222-8421-41fa-8e6a-ee8608722bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8840222-8421-41fa-8e6a-ee8608722bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbeae58b-ec85-4403-8a48-58e081e82a1c', 'volume_name': 'volume-cbeae58b-ec85-4403-8a48-58e081e82a1c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af87e1f1-e61c-448a-88a7-1afd42d4a919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af87e1f1-e61c-448a-88a7-1afd42d4a919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f45af9f-2fb9-429d-b440-ae62fc3627f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Volume cbeae58b-ec85-4403-8a48-58e081e82a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbeae58b-ec85-4403-8a48-58e081e82a1c', 'volume_size': 1}
Jun 24 04:19:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:36 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88" returned: 0 in 1.263s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:19:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:19:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:19:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd64688-16b1-4042-bd9d-c68cc30851d3]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:36 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71
Jun 24 04:19:36 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:37 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" returned: 0 in 1.090s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:37 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:19:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:37 devstack sudo[100276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6
Jun 24 04:19:37 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:44 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6" returned: 0 in 7.272s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ee78d1-940f-4ce0-aa40-a0b38f1f6949]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:45 devstack sudo[100359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71
Jun 24 04:19:45 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:45 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=35,cinder:INSERT=13,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:19:45 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:INSERT=15,cinder:UPDATE=68,cinder:SELECT=49,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:19:45 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" returned: 0 in 1.003s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:45 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71, size 1024.00 MB, duration 7.27 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:19:45 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Converted 1024.00 MB image at 140.77 MB/s
Jun 24 04:19:45 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6 is being set with open permissions: ugo+rw
Jun 24 04:19:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:45 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6
Jun 24 04:19:45 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:46 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-2760b8a8-73df-427d-a00d-30d55f92a0b6" released by "_copy_volume_from_snapshot" :: held 11.562s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-937216d9-2836-444e-9f01-4063c1209d88" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-937216d9-2836-444e-9f01-4063c1209d88" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Deleting offline snapshot 937216d9-2836-444e-9f01-4063c1209d88 of volume 4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:19:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] snapshot_file for this snap is: volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:19:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc78d6-9c5c-4bdc-8d3c-08a3e70a0a23]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:47 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88
Jun 24 04:19:47 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:47 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88" returned: 0 in 1.139s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:19:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb84ae05-a252-4fe2-9641-554be4fd7acd]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:48 devstack sudo[100373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71
Jun 24 04:19:48 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:49 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" returned: 0 in 1.323s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:49 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88
Jun 24 04:19:49 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:50 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88" returned: 0 in 0.874s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:50 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88
Jun 24 04:19:50 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:50 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71.937216d9-2836-444e-9f01-4063c1209d88" returned: 0 in 0.701s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-937216d9-2836-444e-9f01-4063c1209d88" released by "_delete_snapshot" :: held 4.192s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:19:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.042s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.278s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1471432731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbeae58b-ec85-4403-8a48-58e081e82a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49cbd8564cc74c89befafe1a5d2adf7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:35Z,use_quota=True,user_id='cad46b54e9384f4fb130dcf57721801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Creating volume cbeae58b-ec85-4403-8a48-58e081e82a1c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:51 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a502d4-3eaf-4cb9-8d61-e0dcca96e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2760b8a8-73df-427d-a00d-30d55f92a0b6', 'volume_size': 1, 'source_volid': '4b0e4f5b-4f19-40c6-ad09-122fdb4abf71', 'source_volstatus': 'available'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:51 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c 1073741824
Jun 24 04:19:51 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f0f61f-c535-4f70-bd95-45f5f953f5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Volume volume-2760b8a8-73df-427d-a00d-30d55f92a0b6 (2760b8a8-73df-427d-a00d-30d55f92a0b6): created successfully
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f0f61f-c535-4f70-bd95-45f5f953f5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (8d63f88e-c52b-4296-88e1-8a827a245458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c78b0b8d-3170-41a1-a681-47fe1db245c9 tempest-VolumesGetTest-1474065055 None] Created volume successfully.
Jun 24 04:19:52 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c 1073741824" returned: 0 in 1.092s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:52 devstack sudo[100414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c
Jun 24 04:19:52 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Flow 'volume_create_manager' (7d2ba11f-344d-4748-9128-093236915c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ac1321-8b72-4f8f-a7eb-99390ec9df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ac1321-8b72-4f8f-a7eb-99390ec9df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-557633157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1751f018d235430384c77b12f6f53243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:53Z,use_quota=True,user_id='9ae06ff65f0d41ed8476af83fb75991c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac4b934-8dab-41c4-aa87-8917542b28fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac4b934-8dab-41c4-aa87-8917542b28fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4f842e-bff2-43db-8005-f1c35c9e8b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4f842e-bff2-43db-8005-f1c35c9e8b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07', 'volume_name': 'volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a1ab2e-4166-44bd-8f49-eaa75d4dc6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a1ab2e-4166-44bd-8f49-eaa75d4dc6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:52 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17200f6-96c5-4e1d-9fc8-659b7addb18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Volume dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07', 'volume_size': 1}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-557633157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1751f018d235430384c77b12f6f53243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:53Z,use_quota=True,user_id='9ae06ff65f0d41ed8476af83fb75991c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Creating volume dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:52 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:52 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:19:53 devstack sudo[100422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 1073741824
Jun 24 04:19:53 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (379c66c7-d378-4d68-a371-f25ff091d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d780be-3e9f-48d4-a9f2-a30e39243eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d780be-3e9f-48d4-a9f2-a30e39243eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-86992875',display_name='tempest-VolumesGetTest-Volume-1107943787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52046fb6-f346-45ba-b313-ef66ec9308ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:53Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c38aec-904d-41aa-8397-15c457f3905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c38aec-904d-41aa-8397-15c457f3905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ee7cdf-cabe-4ad6-b516-b977b3b63c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ee7cdf-cabe-4ad6-b516-b977b3b63c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52046fb6-f346-45ba-b313-ef66ec9308ce', 'volume_name': 'volume-52046fb6-f346-45ba-b313-ef66ec9308ce', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b0c7d6-7393-4e32-a2b3-62e2e0c7eef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1b0c7d6-7393-4e32-a2b3-62e2e0c7eef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17165743-4565-4460-bb03-b2bc5233703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Volume 52046fb6-f346-45ba-b313-ef66ec9308ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52046fb6-f346-45ba-b313-ef66ec9308ce', 'volume_size': 1}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f45af9f-2fb9-429d-b440-ae62fc3627f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbeae58b-ec85-4403-8a48-58e081e82a1c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f98d544-35c9-49ee-b9a3-5151c4fed97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Volume volume-cbeae58b-ec85-4403-8a48-58e081e82a1c (cbeae58b-ec85-4403-8a48-58e081e82a1c): created successfully
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f98d544-35c9-49ee-b9a3-5151c4fed97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Flow 'volume_create_manager' (6122cbae-77fe-47c2-a475-ec4a0170b4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4333fbf0-9441-4357-8604-212267def607 tempest-ServerActionsTestOtherA-799147312 None] Created volume successfully.
Jun 24 04:19:54 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 1073741824" returned: 0 in 1.126s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:54 devstack sudo[100434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07
Jun 24 04:19:54 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:54 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07" returned: 0 in 0.832s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:19:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-86992875',display_name='tempest-VolumesGetTest-Volume-1107943787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52046fb6-f346-45ba-b313-ef66ec9308ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:19:53Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Creating volume 52046fb6-f346-45ba-b313-ef66ec9308ce {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:19:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:19:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:19:55 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:19:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:55 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce 1073741824
Jun 24 04:19:55 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17200f6-96c5-4e1d-9fc8-659b7addb18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3bdf74-755b-4027-b9d7-fcb70b526472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Volume volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 (dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07): created successfully
Jun 24 04:19:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3bdf74-755b-4027-b9d7-fcb70b526472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Flow 'volume_create_manager' (7d2ba11f-344d-4748-9128-093236915c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9ac973bf-8579-41c1-a1fe-f487d0d3ec14 tempest-AttachVolumeNegativeTest-1227270878 None] Created volume successfully.
Jun 24 04:19:56 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce 1073741824" returned: 0 in 1.155s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:56 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce
Jun 24 04:19:56 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:57 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Jun 24 04:19:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce" returned: 0 in 0.986s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:19:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:19:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:19:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17165743-4565-4460-bb03-b2bc5233703d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52046fb6-f346-45ba-b313-ef66ec9308ce', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8b601e-7964-4285-8693-c1524b328790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:19:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Volume volume-52046fb6-f346-45ba-b313-ef66ec9308ce (52046fb6-f346-45ba-b313-ef66ec9308ce): created successfully
Jun 24 04:19:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8b601e-7964-4285-8693-c1524b328790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:19:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (379c66c7-d378-4d68-a371-f25ff091d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:19:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ac9f49d1-50cf-4913-9e3a-25316888f8db tempest-VolumesGetTest-1474065055 None] Created volume successfully.
Jun 24 04:19:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-52046fb6-f346-45ba-b313-ef66ec9308ce-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Lock "cinder-52046fb6-f346-45ba-b313-ef66ec9308ce-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-52046fb6-f346-45ba-b313-ef66ec9308ce" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:19:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-52046fb6-f346-45ba-b313-ef66ec9308ce" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:19:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c528223-00a4-4beb-9a36-04d7d009933e]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:58 devstack sudo[100502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce
Jun 24 04:19:58 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:19:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-cc0c97f3-c2b4-495d-8771-2ca519a30e70 req-cd520d17-c864-4e44-a0f9-a5f73b335c07 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:19:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-cc0c97f3-c2b4-495d-8771-2ca519a30e70 req-cd520d17-c864-4e44-a0f9-a5f73b335c07 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:19:59 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[30531591-4b90-4730-b6c1-356dda03add1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:19:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-cc0c97f3-c2b4-495d-8771-2ca519a30e70 req-cd520d17-c864-4e44-a0f9-a5f73b335c07 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:19:59 devstack sudo[100512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07
Jun 24 04:19:59 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:00 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce" returned: 0 in 1.520s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:00 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce
Jun 24 04:20:00 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:00 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-cc0c97f3-c2b4-495d-8771-2ca519a30e70 req-cd520d17-c864-4e44-a0f9-a5f73b335c07 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07" returned: 0 in 1.445s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-cc0c97f3-c2b4-495d-8771-2ca519a30e70 req-cd520d17-c864-4e44-a0f9-a5f73b335c07 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.506s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-cc0c97f3-c2b4-495d-8771-2ca519a30e70 req-cd520d17-c864-4e44-a0f9-a5f73b335c07 tempest-AttachVolumeNegativeTest-1227270878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37704230-af78-458d-af67-f1323a031ff2', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:20:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-cc0c97f3-c2b4-495d-8771-2ca519a30e70 req-cd520d17-c864-4e44-a0f9-a5f73b335c07 tempest-AttachVolumeNegativeTest-1227270878 None] attachment_update completed successfully.
Jun 24 04:20:01 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-52046fb6-f346-45ba-b313-ef66ec9308ce" returned: 0 in 1.082s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-52046fb6-f346-45ba-b313-ef66ec9308ce" released by "delete_volume" :: held 2.687s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Created reservations ['ef55780f-1617-480f-ac54-66fcc64a1ba1', 'd3323d91-e8a1-4492-bee1-e70f3a534e7c', '4ffc3766-2168-4b69-abc0-5358ac2291f2', '8225169e-ac43-4c6f-9fca-d211f1a36bf9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:01 devstack sudo[100528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:20:01 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:01 devstack sudo[100594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:20:01 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-2760b8a8-73df-427d-a00d-30d55f92a0b6-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Lock "cinder-2760b8a8-73df-427d-a00d-30d55f92a0b6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-2760b8a8-73df-427d-a00d-30d55f92a0b6" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-2760b8a8-73df-427d-a00d-30d55f92a0b6" acquired by "delete_volume" :: waited 0.048s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868f4c6-32a9-4980-a7c9-c8bb8761169a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:02 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6
Jun 24 04:20:02 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:03 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.442s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Deleted volume successfully.
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e2050cec-f749-4549-bf47-2ae47cffbf4a tempest-VolumesGetTest-1474065055 None] Lock "cinder-52046fb6-f346-45ba-b313-ef66ec9308ce-delete_volume" released by "delete_volume" :: held 4.579s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:03 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.468s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:20:03 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6" returned: 0 in 1.338s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:03 devstack sudo[100924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6
Jun 24 04:20:03 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:04 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2760b8a8-73df-427d-a00d-30d55f92a0b6" returned: 0 in 0.709s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-2760b8a8-73df-427d-a00d-30d55f92a0b6" released by "delete_volume" :: held 2.175s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Created reservations ['8ff80143-3add-4d3e-9833-ed565c1cc16f', '51cda079-cdc6-4932-a889-a6f0050ce538', 'a0c45b35-251f-4aaf-b155-f9231ca9bda2', '5709090d-db73-4ba2-ac52-8babfa136ea6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:04 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:20:04 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:05 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:05 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Deleted volume successfully.
Jun 24 04:20:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1cc49fbc-ecf2-44e4-8ded-ddc1ba42a588 tempest-VolumesGetTest-1474065055 None] Lock "cinder-2760b8a8-73df-427d-a00d-30d55f92a0b6-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Lock "cinder-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd1ed1f-6fec-4a96-9afa-8e74213a0ebe]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:06 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71
Jun 24 04:20:06 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:06 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" returned: 0 in 0.892s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:06 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71
Jun 24 04:20:06 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:07 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" returned: 0 in 0.842s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71" released by "delete_volume" :: held 1.872s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Created reservations ['388b6a1f-061e-4c1e-b40c-dcfef8c88944', 'e6b0cedc-b831-41ed-819e-fd7af2909b03', '3caf89c6-8c8b-41db-a927-ec185bbc56db', '7249d1c0-0ee5-48b4-95f4-cc9fbf182def'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:07 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:20:07 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:08 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.075s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:08 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Deleted volume successfully.
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4030d7e6-b8a3-464f-a8fb-a5b99510adab tempest-VolumesGetTest-1474065055 None] Lock "cinder-4b0e4f5b-4f19-40c6-ad09-122fdb4abf71-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-393e8a15-2cf2-40e5-a961-1b89859db5c9 req-3bd6a5b3-37b0-4bb8-a60a-b6c423735c97 tempest-AttachVolumeNegativeTest-1227270878 None] Terminate volume connection completed successfully.
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-393e8a15-2cf2-40e5-a961-1b89859db5c9 req-3bd6a5b3-37b0-4bb8-a60a-b6c423735c97 tempest-AttachVolumeNegativeTest-1227270878 None] Deleting attachment 37704230-af78-458d-af67-f1323a031ff2. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (fdbe8318-7d89-4d20-a83d-0d748f02f64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377b7252-8ff4-4ad6-930d-b065c7664f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377b7252-8ff4-4ad6-930d-b065c7664f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-235188757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b761ad1-86c4-42ed-a9af-653c76833797,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:10Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6064e8d-efc8-4446-8bf3-517dcb7053e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6064e8d-efc8-4446-8bf3-517dcb7053e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b88027-e58a-4139-bc98-92f4a2f1046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b88027-e58a-4139-bc98-92f4a2f1046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b761ad1-86c4-42ed-a9af-653c76833797', 'volume_name': 'volume-3b761ad1-86c4-42ed-a9af-653c76833797', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f09e6600>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990d38f8-3a4a-4e22-9690-03ae0672aa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990d38f8-3a4a-4e22-9690-03ae0672aa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691ffa40-8b20-4b3e-b021-8a9ccd6a2de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:10 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Volume 3b761ad1-86c4-42ed-a9af-653c76833797: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b761ad1-86c4-42ed-a9af-653c76833797', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f09e6600>}
Jun 24 04:20:10 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Trying to clone 3b761ad1-86c4-42ed-a9af-653c76833797 from image d16527e6-13ec-4d21-b5b6-0410252234f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:20:10 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:20:10 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Image download 20.69 MB at 20.69 MB/s
Jun 24 04:20:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d990dba4-2943-4431-a213-a74c8e866e3d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:10 devstack sudo[100992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD
Jun 24 04:20:10 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:11 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD" returned: 0 in 1.044s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:11 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Temporary image d16527e6-13ec-4d21-b5b6-0410252234f4 is fetched for user 9efc4e01cc214ddcab1772d2bcc0014e. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:20:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9cf56d-a080-4bb4-bb18-b651b67a1a00]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:11 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD
Jun 24 04:20:11 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:12 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-235188757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b761ad1-86c4-42ed-a9af-653c76833797,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:10Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Creating volume 3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:20:12 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:20:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:12 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 1073741824
Jun 24 04:20:12 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:13 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 1073741824" returned: 0 in 0.957s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:13 devstack sudo[101047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797
Jun 24 04:20:13 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:14 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:20:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:14 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Attempting download of d16527e6-13ec-4d21-b5b6-0410252234f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}])) to volume 3b761ad1-86c4-42ed-a9af-653c76833797. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:20:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bad6c7-68f7-47c1-8a01-c3d8948cb587]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_kx7ykhgo {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:14 devstack sudo[101053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_kx7ykhgo
Jun 24 04:20:14 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:15 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_kx7ykhgo" returned: 0 in 0.971s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_kx7ykhgo {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:15 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_kx7ykhgo
Jun 24 04:20:15 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:16 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_kx7ykhgo" returned: 1 in 0.761s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_kx7ykhgo' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:20:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[098df24c-a3de-4037-8aab-e5ae8e43b9c6]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:16 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD
Jun 24 04:20:16 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:16 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD" returned: 0 in 0.961s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:16 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] d16527e6-13ec-4d21-b5b6-0410252234f4 was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:20:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:17 devstack sudo[101069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797
Jun 24 04:20:17 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:19 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797" returned: 0 in 2.439s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:19 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_2jyphmtodevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:20:19 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Converted 112.00 MB image at 45.84 MB/s
Jun 24 04:20:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:19 devstack sudo[101077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 1G
Jun 24 04:20:19 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:20 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 1G" returned: 0 in 0.827s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c153c-3852-4442-96d1-18f958b41340]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:20 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797
Jun 24 04:20:20 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:21 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797" returned: 0 in 0.923s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:21 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797
Jun 24 04:20:21 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:22 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797" returned: 1 in 0.874s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Downloaded image d16527e6-13ec-4d21-b5b6-0410252234f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}])) to volume 3b761ad1-86c4-42ed-a9af-653c76833797 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Temporary image d16527e6-13ec-4d21-b5b6-0410252234f4 for user 9efc4e01cc214ddcab1772d2bcc0014e is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Marking volume 3b761ad1-86c4-42ed-a9af-653c76833797 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Copying metadata from image d16527e6-13ec-4d21-b5b6-0410252234f4 to 3b761ad1-86c4-42ed-a9af-653c76833797. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Creating volume glance metadata for volume 3b761ad1-86c4-42ed-a9af-653c76833797 backed by image d16527e6-13ec-4d21-b5b6-0410252234f4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691ffa40-8b20-4b3e-b021-8a9ccd6a2de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b761ad1-86c4-42ed-a9af-653c76833797', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f09e6600>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacbed60-7b4c-473d-ba52-f68bc55ac205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Volume volume-3b761ad1-86c4-42ed-a9af-653c76833797 (3b761ad1-86c4-42ed-a9af-653c76833797): created successfully
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacbed60-7b4c-473d-ba52-f68bc55ac205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (fdbe8318-7d89-4d20-a83d-0d748f02f64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9512e94b-f036-4fef-969e-567a9a9ac4fa tempest-VolumesGetTest-1474065055 None] Created volume successfully.
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (b9694448-0516-49e8-9f89-3a645326eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43660e9e-8ee7-42e3-9d3d-a925967af5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43660e9e-8ee7-42e3-9d3d-a925967af5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:20:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1763165507',display_name='tempest-VolumesGetTest-Volume-1946692428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a431c233-724a-4acf-af9b-29e2a0ff8d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:23Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dc7d87-cca4-4bd4-8a07-bc8eeccfc490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dc7d87-cca4-4bd4-8a07-bc8eeccfc490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddcdff7-c4b1-47e4-9bec-33c8bc468e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddcdff7-c4b1-47e4-9bec-33c8bc468e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a431c233-724a-4acf-af9b-29e2a0ff8d9b', 'volume_name': 'volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f96949-5505-4bee-b240-967dc8bfec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f96949-5505-4bee-b240-967dc8bfec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305f5d35-cbe6-44c5-b213-7f653c4f63a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:23 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Volume a431c233-724a-4acf-af9b-29e2a0ff8d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b', 'volume_size': 1}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:20:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1763165507',display_name='tempest-VolumesGetTest-Volume-1946692428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a431c233-724a-4acf-af9b-29e2a0ff8d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731c534a4943494bab5736e3acf69fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:23Z,use_quota=True,user_id='9efc4e01cc214ddcab1772d2bcc0014e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Creating volume a431c233-724a-4acf-af9b-29e2a0ff8d9b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:20:23 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:20:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:23 devstack sudo[101104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b 1073741824
Jun 24 04:20:23 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ab10dd03-d6a1-40af-a2df-50ace36881e9 req-22d983e6-bb6e-4a54-80d9-c626618c0ef7 tempest-ServerActionsTestOtherA-799147312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:24 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b 1073741824" returned: 0 in 0.939s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:24 devstack sudo[101121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b
Jun 24 04:20:24 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:25 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b" returned: 0 in 0.683s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ab10dd03-d6a1-40af-a2df-50ace36881e9 req-22d983e6-bb6e-4a54-80d9-c626618c0ef7 tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.823s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305f5d35-cbe6-44c5-b213-7f653c4f63a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4957a1-8b29-467d-a805-67befe9afc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b714c0-3566-4598-b5e9-5eff04d221a8]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-ab10dd03-d6a1-40af-a2df-50ace36881e9 req-22d983e6-bb6e-4a54-80d9-c626618c0ef7 tempest-ServerActionsTestOtherA-799147312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:25 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Volume volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b (a431c233-724a-4acf-af9b-29e2a0ff8d9b): created successfully
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4957a1-8b29-467d-a805-67befe9afc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Flow 'volume_create_manager' (b9694448-0516-49e8-9f89-3a645326eb15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7e60922f-c6cd-4ab2-ace4-55c00fd74ce9 tempest-VolumesGetTest-1474065055 None] Created volume successfully.
Jun 24 04:20:25 devstack sudo[101130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c
Jun 24 04:20:25 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-a431c233-724a-4acf-af9b-29e2a0ff8d9b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Lock "cinder-a431c233-724a-4acf-af9b-29e2a0ff8d9b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-a431c233-724a-4acf-af9b-29e2a0ff8d9b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-a431c233-724a-4acf-af9b-29e2a0ff8d9b" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb58eb-eab0-46f6-82a8-7b6968a0b5de]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:25 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b
Jun 24 04:20:25 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:26 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-ab10dd03-d6a1-40af-a2df-50ace36881e9 req-22d983e6-bb6e-4a54-80d9-c626618c0ef7 tempest-ServerActionsTestOtherA-799147312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ab10dd03-d6a1-40af-a2df-50ace36881e9 req-22d983e6-bb6e-4a54-80d9-c626618c0ef7 tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-ab10dd03-d6a1-40af-a2df-50ace36881e9 req-22d983e6-bb6e-4a54-80d9-c626618c0ef7 tempest-ServerActionsTestOtherA-799147312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-cbeae58b-ec85-4403-8a48-58e081e82a1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1baeb758-bfda-4b25-ae84-a7854122d332', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:20:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-ab10dd03-d6a1-40af-a2df-50ace36881e9 req-22d983e6-bb6e-4a54-80d9-c626618c0ef7 tempest-ServerActionsTestOtherA-799147312 None] attachment_update completed successfully.
Jun 24 04:20:26 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b" returned: 0 in 0.844s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:26 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b
Jun 24 04:20:26 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:27 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a431c233-724a-4acf-af9b-29e2a0ff8d9b" returned: 0 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-a431c233-724a-4acf-af9b-29e2a0ff8d9b" released by "delete_volume" :: held 1.676s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Created reservations ['b675f59a-659d-42cf-ba56-309bccda7083', '779ffc77-2f49-4730-976e-dbfdb9eb9620', 'dc5d183d-ce18-456c-8c31-9375b01685b8', 'df5671ea-1a50-473b-a1a6-1039e7e8672f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:27 devstack sudo[101528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:20:27 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-3b761ad1-86c4-42ed-a9af-653c76833797-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Lock "cinder-3b761ad1-86c4-42ed-a9af-653c76833797-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Acquiring lock "cinder-quobyte-3b761ad1-86c4-42ed-a9af-653c76833797" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-3b761ad1-86c4-42ed-a9af-653c76833797" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf9e54-2320-4ea1-9c2a-6035b4d238bb]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:28 devstack sudo[101530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797
Jun 24 04:20:28 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:28 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.949s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Deleted volume successfully.
Jun 24 04:20:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-43596eb7-72f6-4579-969e-94b14f5d4e07 tempest-VolumesGetTest-1474065055 None] Lock "cinder-a431c233-724a-4acf-af9b-29e2a0ff8d9b-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:29 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797" returned: 0 in 0.945s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:29 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797
Jun 24 04:20:29 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:30 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797" returned: 1 in 0.989s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:20:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:30 devstack sudo[101559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797
Jun 24 04:20:30 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:31 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3b761ad1-86c4-42ed-a9af-653c76833797" returned: 0 in 0.827s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Lock "cinder-quobyte-3b761ad1-86c4-42ed-a9af-653c76833797" released by "delete_volume" :: held 2.868s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Created reservations ['b7b70dae-2aa7-4879-b0ca-4010542e0f8f', '629acd40-5e13-4329-b157-de958ad36930', 'b670a342-54f2-4066-ab3d-da618a317598', '5760f196-04eb-41d7-90de-f60d52ab23b8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:31 devstack sudo[101571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:20:31 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:32 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.860s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:32 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:20:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Deleted volume successfully.
Jun 24 04:20:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5bd022a-d2f0-421e-aae0-b9f9dacbfd46 tempest-VolumesGetTest-1474065055 None] Lock "cinder-3b761ad1-86c4-42ed-a9af-653c76833797-delete_volume" released by "delete_volume" :: held 4.084s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:20:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-0978cf87-7913-4226-adfd-fd5e4d8f387b tempest-ServerActionsTestOtherA-799147312 None] Terminate volume connection completed successfully.
Jun 24 04:20:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-0978cf87-7913-4226-adfd-fd5e4d8f387b tempest-ServerActionsTestOtherA-799147312 None] Deleting attachment 1baeb758-bfda-4b25-ae84-a7854122d332. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:20:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-2299bfba-c5e5-44a3-aa27-d47b05e737fb tempest-ServerActionsTestOtherA-799147312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-2299bfba-c5e5-44a3-aa27-d47b05e737fb tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bbbd82-cad7-4f3b-bdbf-b3201da7fb64]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:20:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-2299bfba-c5e5-44a3-aa27-d47b05e737fb tempest-ServerActionsTestOtherA-799147312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:39 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c
Jun 24 04:20:39 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Flow 'volume_create_manager' (eea75fe9-f7b5-4cbb-958a-cfc58b5023e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbc3ed3-6a69-41fb-871f-21d09e13cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbc3ed3-6a69-41fb-871f-21d09e13cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-468642128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642abd1b-ee2e-443f-8d4b-9b7ad781a626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f79691872a45cea48ae3d7b4d47cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:40Z,use_quota=True,user_id='ea16579db7234b32b7a6eb1e115ec385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979820b9-8b5e-419e-a781-a848c35f12c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979820b9-8b5e-419e-a781-a848c35f12c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99232157-dcc7-4f66-8754-89a60a623dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99232157-dcc7-4f66-8754-89a60a623dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642abd1b-ee2e-443f-8d4b-9b7ad781a626', 'volume_name': 'volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3be6255-4004-447c-a556-9b4dd4d362b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3be6255-4004-447c-a556-9b4dd4d362b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e170522-770d-4860-9c60-06665e7b306e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Volume 642abd1b-ee2e-443f-8d4b-9b7ad781a626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626', 'volume_size': 1}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:40 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-2299bfba-c5e5-44a3-aa27-d47b05e737fb tempest-ServerActionsTestOtherA-799147312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c" returned: 0 in 1.415s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-2299bfba-c5e5-44a3-aa27-d47b05e737fb tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.449s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.230s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-468642128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642abd1b-ee2e-443f-8d4b-9b7ad781a626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57f79691872a45cea48ae3d7b4d47cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:20:40Z,use_quota=True,user_id='ea16579db7234b32b7a6eb1e115ec385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Creating volume 642abd1b-ee2e-443f-8d4b-9b7ad781a626 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:20:40 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:20:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:41 devstack sudo[101920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626 1073741824
Jun 24 04:20:41 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-2299bfba-c5e5-44a3-aa27-d47b05e737fb tempest-ServerActionsTestOtherA-799147312 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-cbeae58b-ec85-4403-8a48-58e081e82a1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7759e701-15cf-4139-93c0-aafc34598f77', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:20:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-e889c7d5-f8ea-457f-8e4a-a05a265cef22 req-2299bfba-c5e5-44a3-aa27-d47b05e737fb tempest-ServerActionsTestOtherA-799147312 None] attachment_update completed successfully.
Jun 24 04:20:43 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626 1073741824" returned: 0 in 2.088s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:20:43 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626
Jun 24 04:20:43 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:20:44 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Jun 24 04:20:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626" returned: 0 in 1.736s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:20:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] <== create_volume: return (3905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:20:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.910s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:20:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e170522-770d-4860-9c60-06665e7b306e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a943aa8a-f8d8-4ef0-a66f-eca688682247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:20:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Volume volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626 (642abd1b-ee2e-443f-8d4b-9b7ad781a626): created successfully
Jun 24 04:20:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a943aa8a-f8d8-4ef0-a66f-eca688682247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:20:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Flow 'volume_create_manager' (eea75fe9-f7b5-4cbb-958a-cfc58b5023e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:20:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-22cd4060-936b-4503-bdd2-1aa9d1e91162 tempest-VolumesNegativeTest-193785476 None] Created volume successfully.
Jun 24 04:20:54 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=75,cinder:SELECT=60,cinder:INSERT=25,cinder:DELETE=9 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:20:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=59,cinder:SELECT=66,cinder:INSERT=15,cinder:DELETE=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:21:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:21:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:01 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:21:01 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:03 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.518s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:03 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:21:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:21:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Flow 'volume_create_manager' (bcbb6c77-ba2b-45b6-87f5-7b91f79fad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b774d70d-cef8-49bf-9a8c-0e3d704c8f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b774d70d-cef8-49bf-9a8c-0e3d704c8f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1436143431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a925127-d47f-4962-9856-feb501d912c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96343ebfe3a24dc887219bbd10cbf56e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:05Z,use_quota=True,user_id='4a12d4fbdc2f48d28932b305daa91bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf7fabd-1545-46f2-9370-8b1c75426afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf7fabd-1545-46f2-9370-8b1c75426afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4a97f0-31b1-4e4e-89c1-8046025620e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de4a97f0-31b1-4e4e-89c1-8046025620e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a925127-d47f-4962-9856-feb501d912c7', 'volume_name': 'volume-2a925127-d47f-4962-9856-feb501d912c7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7e768e-dfc1-472e-9549-4dc4883fbb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7e768e-dfc1-472e-9549-4dc4883fbb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97519941-c56b-46e7-954d-aac66f2be701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Volume 2a925127-d47f-4962-9856-feb501d912c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a925127-d47f-4962-9856-feb501d912c7', 'volume_size': 1}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1436143431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a925127-d47f-4962-9856-feb501d912c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96343ebfe3a24dc887219bbd10cbf56e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:05Z,use_quota=True,user_id='4a12d4fbdc2f48d28932b305daa91bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Creating volume 2a925127-d47f-4962-9856-feb501d912c7 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:21:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:05 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7 1073741824
Jun 24 04:21:05 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Flow 'volume_create_manager' (caa98f8d-e868-4937-b239-97fc1cdb83f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ea87a8-667a-4f7f-9b0b-333c72f35d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ea87a8-667a-4f7f-9b0b-333c72f35d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1632137273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e71245-978c-476b-ac2c-3c0afa30bee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1751f018d235430384c77b12f6f53243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:06Z,use_quota=True,user_id='9ae06ff65f0d41ed8476af83fb75991c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e8df88-69e9-41cd-b6f2-ea481a8c232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e8df88-69e9-41cd-b6f2-ea481a8c232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63e76e6-0f5f-45c4-9125-adc92c964fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63e76e6-0f5f-45c4-9125-adc92c964fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e71245-978c-476b-ac2c-3c0afa30bee2', 'volume_name': 'volume-63e71245-978c-476b-ac2c-3c0afa30bee2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cf0624-1b0e-4e9c-9002-ee9806cb55ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cf0624-1b0e-4e9c-9002-ee9806cb55ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa6002e-d53c-48ad-ae61-1fafd9bb046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Volume 63e71245-978c-476b-ac2c-3c0afa30bee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e71245-978c-476b-ac2c-3c0afa30bee2', 'volume_size': 1}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:06 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7 1073741824" returned: 0 in 1.225s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:06 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7
Jun 24 04:21:06 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:07 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7" returned: 0 in 0.700s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1632137273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e71245-978c-476b-ac2c-3c0afa30bee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1751f018d235430384c77b12f6f53243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:21:06Z,use_quota=True,user_id='9ae06ff65f0d41ed8476af83fb75991c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Creating volume 63e71245-978c-476b-ac2c-3c0afa30bee2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:07 devstack sudo[102665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2 1073741824
Jun 24 04:21:07 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97519941-c56b-46e7-954d-aac66f2be701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a925127-d47f-4962-9856-feb501d912c7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3eed30c-6605-4413-af35-4ae8ab203960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Volume volume-2a925127-d47f-4962-9856-feb501d912c7 (2a925127-d47f-4962-9856-feb501d912c7): created successfully
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3eed30c-6605-4413-af35-4ae8ab203960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Flow 'volume_create_manager' (bcbb6c77-ba2b-45b6-87f5-7b91f79fad7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-264bf36d-004b-4c43-ae5c-5c51f872e5a4 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Created volume successfully.
Jun 24 04:21:08 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2 1073741824" returned: 0 in 1.291s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:08 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2
Jun 24 04:21:08 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:09 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2" returned: 0 in 0.758s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:21:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa6002e-d53c-48ad-ae61-1fafd9bb046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e71245-978c-476b-ac2c-3c0afa30bee2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8bf56c-2880-4a93-a830-7a0f61e1a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Volume volume-63e71245-978c-476b-ac2c-3c0afa30bee2 (63e71245-978c-476b-ac2c-3c0afa30bee2): created successfully
Jun 24 04:21:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8bf56c-2880-4a93-a830-7a0f61e1a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Flow 'volume_create_manager' (caa98f8d-e868-4937-b239-97fc1cdb83f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b0ac20fc-9be3-42a4-b249-681c80acf8db tempest-AttachVolumeNegativeTest-1227270878 None] Created volume successfully.
Jun 24 04:21:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4f819b76-81cd-4e78-8fcf-8c41d1e9b42e req-38bad792-6d1a-4857-b79f-081a8256bf37 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4f819b76-81cd-4e78-8fcf-8c41d1e9b42e req-38bad792-6d1a-4857-b79f-081a8256bf37 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bf71dc-2675-43be-8685-5e9e9608f06a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-4f819b76-81cd-4e78-8fcf-8c41d1e9b42e req-38bad792-6d1a-4857-b79f-081a8256bf37 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:11 devstack sudo[102786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7
Jun 24 04:21:11 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:12 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-4f819b76-81cd-4e78-8fcf-8c41d1e9b42e req-38bad792-6d1a-4857-b79f-081a8256bf37 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7" returned: 0 in 0.822s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4f819b76-81cd-4e78-8fcf-8c41d1e9b42e req-38bad792-6d1a-4857-b79f-081a8256bf37 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4f819b76-81cd-4e78-8fcf-8c41d1e9b42e req-38bad792-6d1a-4857-b79f-081a8256bf37 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-2a925127-d47f-4962-9856-feb501d912c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd48217a-c69f-4762-9d66-ddde49a4049f', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:21:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-4f819b76-81cd-4e78-8fcf-8c41d1e9b42e req-38bad792-6d1a-4857-b79f-081a8256bf37 tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] attachment_update completed successfully.
Jun 24 04:21:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-6e00ceae-c13f-4425-ae6b-4acc3cf6f102 req-76f0405f-968c-43bc-b678-98945d7b41f5 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-6e00ceae-c13f-4425-ae6b-4acc3cf6f102 req-76f0405f-968c-43bc-b678-98945d7b41f5 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8690e9a6-9577-47cb-9e18-2221ba82f08d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-6e00ceae-c13f-4425-ae6b-4acc3cf6f102 req-76f0405f-968c-43bc-b678-98945d7b41f5 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:13 devstack sudo[102808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2
Jun 24 04:21:13 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:14 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-6e00ceae-c13f-4425-ae6b-4acc3cf6f102 req-76f0405f-968c-43bc-b678-98945d7b41f5 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-6e00ceae-c13f-4425-ae6b-4acc3cf6f102 req-76f0405f-968c-43bc-b678-98945d7b41f5 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-6e00ceae-c13f-4425-ae6b-4acc3cf6f102 req-76f0405f-968c-43bc-b678-98945d7b41f5 tempest-AttachVolumeNegativeTest-1227270878 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-63e71245-978c-476b-ac2c-3c0afa30bee2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5ba6a26-89e9-42e9-8703-13be71d48f01', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:21:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-6e00ceae-c13f-4425-ae6b-4acc3cf6f102 req-76f0405f-968c-43bc-b678-98945d7b41f5 tempest-AttachVolumeNegativeTest-1227270878 None] attachment_update completed successfully.
Jun 24 04:21:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-9e6f8bc2-2ba3-4304-9377-eede9877e1f1 req-177e339b-8ee7-4392-8e1e-ebb36b4350e3 tempest-ServerActionsTestOtherA-799147312 None] Terminate volume connection completed successfully.
Jun 24 04:21:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-9e6f8bc2-2ba3-4304-9377-eede9877e1f1 req-177e339b-8ee7-4392-8e1e-ebb36b4350e3 tempest-ServerActionsTestOtherA-799147312 None] Deleting attachment 7759e701-15cf-4139-93c0-aafc34598f77. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:21:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-25304f29-2361-4a92-86b8-7a48bef3d384 req-f0a2467b-98eb-4313-873f-c6a5be95830a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Terminate volume connection completed successfully.
Jun 24 04:21:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-25304f29-2361-4a92-86b8-7a48bef3d384 req-f0a2467b-98eb-4313-873f-c6a5be95830a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Deleting attachment dd48217a-c69f-4762-9d66-ddde49a4049f. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:21:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Acquiring lock "cinder-642abd1b-ee2e-443f-8d4b-9b7ad781a626-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Lock "cinder-642abd1b-ee2e-443f-8d4b-9b7ad781a626-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Acquiring lock "cinder-quobyte-642abd1b-ee2e-443f-8d4b-9b7ad781a626" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Lock "cinder-quobyte-642abd1b-ee2e-443f-8d4b-9b7ad781a626" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f364f7-1217-4ba8-9810-acdba9f61963]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:20 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626
Jun 24 04:21:20 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Acquiring lock "cinder-2a925127-d47f-4962-9856-feb501d912c7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "cinder-2a925127-d47f-4962-9856-feb501d912c7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Acquiring lock "cinder-quobyte-2a925127-d47f-4962-9856-feb501d912c7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "cinder-quobyte-2a925127-d47f-4962-9856-feb501d912c7" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[876a37fc-5a95-4c15-86ff-5fd2707a6e0d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:21 devstack sudo[102879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7
Jun 24 04:21:21 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-71be23a7-6458-4b33-a323-7ff2e938bc7c req-e8d52c8b-9a32-45e6-97ac-1400d522216d tempest-AttachVolumeNegativeTest-1227270878 None] Terminate volume connection completed successfully.
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-71be23a7-6458-4b33-a323-7ff2e938bc7c req-e8d52c8b-9a32-45e6-97ac-1400d522216d tempest-AttachVolumeNegativeTest-1227270878 None] Deleting attachment e5ba6a26-89e9-42e9-8703-13be71d48f01. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:21:21 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626" returned: 0 in 1.076s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:21 devstack sudo[102889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626
Jun 24 04:21:21 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:22 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7" returned: 0 in 0.962s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:22 devstack sudo[102894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7
Jun 24 04:21:22 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:22 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-642abd1b-ee2e-443f-8d4b-9b7ad781a626" returned: 0 in 0.671s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Lock "cinder-quobyte-642abd1b-ee2e-443f-8d4b-9b7ad781a626" released by "delete_volume" :: held 1.806s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Created reservations ['9b1fd8ce-c0ab-4ef4-a998-c89e2562292e', '4c18df27-2dbd-4ab9-8568-bc76ac0f72e6', '7480765d-8e15-422b-aacb-8281174f9d30', 'd0e0ef27-5a04-40b6-b1ca-3d33a8f116ec'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:22 devstack sudo[102897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:21:22 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:22 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2a925127-d47f-4962-9856-feb501d912c7" returned: 0 in 0.707s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "cinder-quobyte-2a925127-d47f-4962-9856-feb501d912c7" released by "delete_volume" :: held 1.731s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Created reservations ['a344468e-4c37-465e-8ca3-3944d40d505c', '9fda593c-8d0e-4162-9012-0c1a2334805e', '90f40f5b-acf2-4bbd-a658-24a6bff01898', '5e8f0af0-6690-4b4d-a635-1636e6e59e77'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:23 devstack sudo[102900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:21:23 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:23 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.953s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Deleted volume successfully.
Jun 24 04:21:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3069b464-c822-4795-b87a-e2f03af9e96f tempest-VolumesNegativeTest-193785476 None] Lock "cinder-642abd1b-ee2e-443f-8d4b-9b7ad781a626-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:24 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.933s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:24 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Deleted volume successfully.
Jun 24 04:21:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a1b2f80d-4d29-4383-9bec-0ce27f82628a tempest-TestServerVolumeAttachScenarioOldVersion-1136178698 None] Lock "cinder-2a925127-d47f-4962-9856-feb501d912c7-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Acquiring lock "cinder-cbeae58b-ec85-4403-8a48-58e081e82a1c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Lock "cinder-cbeae58b-ec85-4403-8a48-58e081e82a1c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Acquiring lock "cinder-quobyte-cbeae58b-ec85-4403-8a48-58e081e82a1c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Lock "cinder-quobyte-cbeae58b-ec85-4403-8a48-58e081e82a1c" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e818461-63b3-4a98-8d2f-7067286cebbc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:27 devstack sudo[103081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c
Jun 24 04:21:27 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:28 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c" returned: 0 in 1.101s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:28 devstack sudo[103090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c
Jun 24 04:21:28 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:29 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-cbeae58b-ec85-4403-8a48-58e081e82a1c" returned: 0 in 0.863s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Lock "cinder-quobyte-cbeae58b-ec85-4403-8a48-58e081e82a1c" released by "delete_volume" :: held 2.017s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Created reservations ['ffd7e4b6-6a2e-4033-9c95-5d36f6e37b33', 'a27aafbc-e6bf-466f-942c-b822bd46545b', '187a3c4e-96ce-483d-9b4c-d5ea3aed3a5c', 'd5f9daac-db12-4e77-b8de-1b7c202b0836'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:29 devstack sudo[103095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:21:29 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:30 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.796s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:30 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Deleted volume successfully.
Jun 24 04:21:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0bd8fa70-4465-4e79-9a4d-09e8c411119f tempest-ServerActionsTestOtherA-799147312 None] Lock "cinder-cbeae58b-ec85-4403-8a48-58e081e82a1c-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "cinder-63e71245-978c-476b-ac2c-3c0afa30bee2-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-63e71245-978c-476b-ac2c-3c0afa30bee2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "cinder-quobyte-63e71245-978c-476b-ac2c-3c0afa30bee2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-quobyte-63e71245-978c-476b-ac2c-3c0afa30bee2" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4754dc-f9f7-429f-b3f5-806019c670e9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:35 devstack sudo[103146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2
Jun 24 04:21:35 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:36 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2" returned: 0 in 0.956s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:36 devstack sudo[103151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2
Jun 24 04:21:36 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:37 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-63e71245-978c-476b-ac2c-3c0afa30bee2" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-quobyte-63e71245-978c-476b-ac2c-3c0afa30bee2" released by "delete_volume" :: held 1.829s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Created reservations ['8b4608ca-a976-47fb-b85b-98bf8b08a7e6', '9ada63eb-6915-42ba-a965-4a92715ea78f', 'c1fdb12d-8940-4d8d-b1f8-eeb92f1c5f75', '208e5aac-d134-4a34-91e9-6c5bf6dc5d65'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:37 devstack sudo[103155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:21:37 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "cinder-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "cinder-quobyte-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-quobyte-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1835c45a-df06-4484-b403-eafe4ca429f7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:38 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07
Jun 24 04:21:38 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:38 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.184s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:38 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Deleted volume successfully.
Jun 24 04:21:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e689053c-fdd5-4f08-a08e-04184693961b tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-63e71245-978c-476b-ac2c-3c0afa30bee2-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:39 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07" returned: 0 in 1.114s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:39 devstack sudo[103163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07
Jun 24 04:21:39 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:39 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07" returned: 0 in 0.771s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-quobyte-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07" released by "delete_volume" :: held 1.949s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Created reservations ['aba5f6eb-1034-4cd5-8543-c7513d4c7263', 'a28db046-f47f-4a95-9a92-cb8b681c95de', '1044c8aa-95aa-46cc-80f9-dab54299b2cb', '8a2d30bf-a2b9-4dbb-85e3-1f8c15016cb4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:40 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:21:40 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "cinder-afb6f308-6362-4054-ab0d-7145c6c99244-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-afb6f308-6362-4054-ab0d-7145c6c99244-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "cinder-quobyte-afb6f308-6362-4054-ab0d-7145c6c99244" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-quobyte-afb6f308-6362-4054-ab0d-7145c6c99244" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ae09f-2c54-4434-be0a-0684fb52d42f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:21:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:40 devstack sudo[103169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244
Jun 24 04:21:40 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:41 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.856s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:41 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Deleted volume successfully.
Jun 24 04:21:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8231f2b7-60a6-40a6-868a-7d2245a81c57 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-dbe71fd6-4e2b-4ea0-bdcd-5358162bcc07-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:41 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244" returned: 0 in 0.973s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:41 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244
Jun 24 04:21:41 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:42 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-afb6f308-6362-4054-ab0d-7145c6c99244" returned: 0 in 0.817s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-quobyte-afb6f308-6362-4054-ab0d-7145c6c99244" released by "delete_volume" :: held 1.874s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Created reservations ['0f6b547e-862a-4bec-8ef9-8fa7dd825252', 'fbc2f9a2-e622-4835-b8b4-91f27086c579', 'c101d800-e0c9-43f8-83d9-7c29e46ab45d', 'fc7c786b-12b2-4fae-a98c-76d038700a53'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:42 devstack sudo[103179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:21:42 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:21:43 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root
Jun 24 04:21:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.929s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:21:43 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:21:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Deleted volume successfully.
Jun 24 04:21:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6c764fb8-5852-43d6-8f4d-eee6da2237f1 tempest-AttachVolumeNegativeTest-1227270878 None] Lock "cinder-afb6f308-6362-4054-ab0d-7145c6c99244-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:21:52 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=43,cinder:UPDATE=58,cinder:INSERT=12,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:21:53 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=57,cinder:SELECT=54,cinder:INSERT=14,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Flow 'volume_create_manager' (b7b20ae9-c184-424c-8735-242bd47cc0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6923ccd-bf45-474e-967c-16ea6fc64ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6923ccd-bf45-474e-967c-16ea6fc64ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-99813654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907348af-65f7-4f95-aeef-5b416285e636,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9d4f6899361492986dde5f899f27362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:00Z,use_quota=True,user_id='417faa2120db47b5bb05222301bb8782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a46296-816b-448b-b31c-039478e3ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a46296-816b-448b-b31c-039478e3ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ad017e-323f-447c-98f0-48c11f096180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ad017e-323f-447c-98f0-48c11f096180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907348af-65f7-4f95-aeef-5b416285e636', 'volume_name': 'volume-907348af-65f7-4f95-aeef-5b416285e636', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da111b00-a83f-4214-aa88-24c4617f6e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da111b00-a83f-4214-aa88-24c4617f6e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3c8685-3af4-428a-8d9e-dff3e03b2bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:21:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Volume 907348af-65f7-4f95-aeef-5b416285e636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907348af-65f7-4f95-aeef-5b416285e636', 'volume_size': 1}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-99813654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907348af-65f7-4f95-aeef-5b416285e636,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9d4f6899361492986dde5f899f27362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:00Z,use_quota=True,user_id='417faa2120db47b5bb05222301bb8782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Creating volume 907348af-65f7-4f95-aeef-5b416285e636 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:21:59 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:21:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:21:59 devstack sudo[103226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636 1073741824
Jun 24 04:21:59 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Flow 'volume_create_manager' (f582f276-7275-4768-a7fa-b7731250e143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74155b46-f7a3-4aca-83d6-3b6478725a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74155b46-f7a3-4aca-83d6-3b6478725a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-471636179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2607e4f-d3b0-43f9-8754-03deb77112cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0584880e2ee440ea1d29efdf0fd6739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:00Z,use_quota=True,user_id='1f82eaf39d8d43138be1f8872b337e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6173272e-3c1b-490a-8b52-9a19a21e07b1),volume_type_id=6173272e-3c1b-490a-8b52-9a19a21e07b1)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5372c68c-01a8-47a8-b4b8-fcced5bd6e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5372c68c-01a8-47a8-b4b8-fcced5bd6e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9ff346-6b3a-42ea-9d09-665f26739ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9ff346-6b3a-42ea-9d09-665f26739ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2607e4f-d3b0-43f9-8754-03deb77112cc', 'volume_name': 'volume-a2607e4f-d3b0-43f9-8754-03deb77112cc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7574846-4570-495e-b248-9b0958bfcac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7574846-4570-495e-b248-9b0958bfcac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7b2eb3-58ce-412a-b74d-d3f67cc1f82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume a2607e4f-d3b0-43f9-8754-03deb77112cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2607e4f-d3b0-43f9-8754-03deb77112cc', 'volume_size': 1}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Flow 'volume_create_manager' (0f0d9f9d-f279-48b3-a973-fc930c7df438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca61de16-d02f-4217-8226-e53a4c9646b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca61de16-d02f-4217-8226-e53a4c9646b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1668796638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445a1125-7647-422a-adfb-f92b2f2b7b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0584880e2ee440ea1d29efdf0fd6739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:01Z,use_quota=True,user_id='1f82eaf39d8d43138be1f8872b337e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5365d16e-6a16-4805-9756-a78845ce0d5c),volume_type_id=5365d16e-6a16-4805-9756-a78845ce0d5c)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01be2d7-e855-4c26-bd65-907dc013ac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01be2d7-e855-4c26-bd65-907dc013ac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5899775d-9d07-4a33-ac91-14fdd77db55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5899775d-9d07-4a33-ac91-14fdd77db55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445a1125-7647-422a-adfb-f92b2f2b7b7f', 'volume_name': 'volume-445a1125-7647-422a-adfb-f92b2f2b7b7f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebc0a0a-8eb0-440e-a82a-1e6b86c9d107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebc0a0a-8eb0-440e-a82a-1e6b86c9d107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff71379-bea5-4860-a42b-f0226ec40de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume 445a1125-7647-422a-adfb-f92b2f2b7b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445a1125-7647-422a-adfb-f92b2f2b7b7f', 'volume_size': 1}
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:01 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636 1073741824" returned: 0 in 1.389s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:01 devstack sudo[103232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636
Jun 24 04:22:01 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:01 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:22:01 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:02 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636" returned: 0 in 0.944s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] <== create_volume: return (2403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-471636179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2607e4f-d3b0-43f9-8754-03deb77112cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0584880e2ee440ea1d29efdf0fd6739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:00Z,use_quota=True,user_id='1f82eaf39d8d43138be1f8872b337e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6173272e-3c1b-490a-8b52-9a19a21e07b1),volume_type_id=6173272e-3c1b-490a-8b52-9a19a21e07b1)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Creating volume a2607e4f-d3b0-43f9-8754-03deb77112cc {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:02 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:02 devstack sudo[103237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc 1073741824
Jun 24 04:22:02 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3c8685-3af4-428a-8d9e-dff3e03b2bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907348af-65f7-4f95-aeef-5b416285e636', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc520aac-5719-4135-83cf-7cabd34f2927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Flow 'volume_create_manager' (88e28f6c-7d50-4139-81c8-c8307483c801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf54125-ae70-43d6-b18e-a80ac600fd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf54125-ae70-43d6-b18e-a80ac600fd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1855035521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16020797-42fa-4032-9de9-b4e87f46dad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0584880e2ee440ea1d29efdf0fd6739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:02Z,use_quota=True,user_id='1f82eaf39d8d43138be1f8872b337e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5d51bfe-1e66-4c94-b915-a5a0e39903eb),volume_type_id=e5d51bfe-1e66-4c94-b915-a5a0e39903eb)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d95d1a8-d9fb-49d7-b38e-b9b4bf030dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d95d1a8-d9fb-49d7-b38e-b9b4bf030dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307d1920-0348-45a1-a1d0-6fa6438042f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:22:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Volume volume-907348af-65f7-4f95-aeef-5b416285e636 (907348af-65f7-4f95-aeef-5b416285e636): created successfully
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc520aac-5719-4135-83cf-7cabd34f2927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Flow 'volume_create_manager' (b7b20ae9-c184-424c-8735-242bd47cc0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6c83a429-8492-40ee-9b7d-3d3dc4b0bf3c tempest-VolumesTestJSON-1300771399 None] Created volume successfully.
Jun 24 04:22:02 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.923s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:22:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:22:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307d1920-0348-45a1-a1d0-6fa6438042f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16020797-42fa-4032-9de9-b4e87f46dad2', 'volume_name': 'volume-16020797-42fa-4032-9de9-b4e87f46dad2', 'volume_size': 1, 'image_id': '6a968e02-4495-475e-8220-2ff19b859e62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a968e02-4495-475e-8220-2ff19b859e62', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--317560246', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f0584880e2ee440ea1d29efdf0fd6739', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6a968e02-4495-475e-8220-2ff19b859e62', 'created_at': datetime.datetime(2026, 6, 24, 2, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 21, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a968e02-4495-475e-8220-2ff19b859e62/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f06316d0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5763e3-b9b1-433d-aa23-c736c1effff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5763e3-b9b1-433d-aa23-c736c1effff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5a2deb-b7e5-42ac-81ad-8d4c58e18d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume 16020797-42fa-4032-9de9-b4e87f46dad2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16020797-42fa-4032-9de9-b4e87f46dad2', 'volume_size': 1, 'image_id': '6a968e02-4495-475e-8220-2ff19b859e62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a968e02-4495-475e-8220-2ff19b859e62', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--317560246', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f0584880e2ee440ea1d29efdf0fd6739', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6a968e02-4495-475e-8220-2ff19b859e62', 'created_at': datetime.datetime(2026, 6, 24, 2, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 21, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a968e02-4495-475e-8220-2ff19b859e62/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f06316d0>}
Jun 24 04:22:03 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Trying to clone 16020797-42fa-4032-9de9-b4e87f46dad2 from image 6a968e02-4495-475e-8220-2ff19b859e62 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6a968e02-4495-475e-8220-2ff19b859e62', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:22:03 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc 1073741824" returned: 0 in 1.507s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:03 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc
Jun 24 04:22:03 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Flow 'volume_create_manager' (af5761bb-ab3d-4fd7-b39d-7d1c95e3dfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcf6e0d-7e77-4b0f-b846-0ed57eead03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcf6e0d-7e77-4b0f-b846-0ed57eead03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-662357487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75023552-6f3f-4ac9-becf-b9bf9395e8e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9d4f6899361492986dde5f899f27362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:04Z,use_quota=True,user_id='417faa2120db47b5bb05222301bb8782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7552bf1-23c4-4172-9e28-220a9b10078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7552bf1-23c4-4172-9e28-220a9b10078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4dc6ee-40c2-46dc-b260-7c4202cdd99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4dc6ee-40c2-46dc-b260-7c4202cdd99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75023552-6f3f-4ac9-becf-b9bf9395e8e0', 'volume_name': 'volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5d9eb5-7d2c-44f8-a4db-d43200666789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5d9eb5-7d2c-44f8-a4db-d43200666789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aad0063-cdb0-423b-98c9-1fe0ffef8395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:04 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Volume 75023552-6f3f-4ac9-becf-b9bf9395e8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0', 'volume_size': 1}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:04 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc" returned: 0 in 1.088s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] <== create_volume: return (2700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.705s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1668796638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445a1125-7647-422a-adfb-f92b2f2b7b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0584880e2ee440ea1d29efdf0fd6739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:01Z,use_quota=True,user_id='1f82eaf39d8d43138be1f8872b337e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5365d16e-6a16-4805-9756-a78845ce0d5c),volume_type_id=5365d16e-6a16-4805-9756-a78845ce0d5c)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Creating volume 445a1125-7647-422a-adfb-f92b2f2b7b7f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:04 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:04 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f 1073741824
Jun 24 04:22:04 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7b2eb3-58ce-412a-b74d-d3f67cc1f82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2607e4f-d3b0-43f9-8754-03deb77112cc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ce43cb-822d-487a-b8f4-ae64463124a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume volume-a2607e4f-d3b0-43f9-8754-03deb77112cc (a2607e4f-d3b0-43f9-8754-03deb77112cc): created successfully
Jun 24 04:22:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ce43cb-822d-487a-b8f4-ae64463124a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Flow 'volume_create_manager' (f582f276-7275-4768-a7fa-b7731250e143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5d025728-22fd-4c17-85ae-eb77a1c14817 tempest-TestInstancesWithCinderVolumes-1689130223 None] Created volume successfully.
Jun 24 04:22:06 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f 1073741824" returned: 0 in 1.181s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:06 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f
Jun 24 04:22:06 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:07 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f" returned: 0 in 0.910s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.645s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-662357487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75023552-6f3f-4ac9-becf-b9bf9395e8e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9d4f6899361492986dde5f899f27362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:04Z,use_quota=True,user_id='417faa2120db47b5bb05222301bb8782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Creating volume 75023552-6f3f-4ac9-becf-b9bf9395e8e0 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:07 devstack sudo[103257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0 1073741824
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff71379-bea5-4860-a42b-f0226ec40de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445a1125-7647-422a-adfb-f92b2f2b7b7f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:07 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e332e6-536e-4c96-bf6b-2fdb77bcd91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume volume-445a1125-7647-422a-adfb-f92b2f2b7b7f (445a1125-7647-422a-adfb-f92b2f2b7b7f): created successfully
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e332e6-536e-4c96-bf6b-2fdb77bcd91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Flow 'volume_create_manager' (0f0d9f9d-f279-48b3-a973-fc930c7df438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e9ee6d07-9ca3-4647-8c50-d4fb166931c5 tempest-TestInstancesWithCinderVolumes-1689130223 None] Created volume successfully.
Jun 24 04:22:08 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0 1073741824" returned: 0 in 1.133s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:08 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0
Jun 24 04:22:08 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:08 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD, size 20.69 MB, duration 5.32 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:22:08 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Image download 20.69 MB at 3.89 MB/s
Jun 24 04:22:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fdc291-6e43-4a96-86ca-163b7cebf8dd]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:08 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD
Jun 24 04:22:08 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:09 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0" returned: 0 in 0.914s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aad0063-cdb0-423b-98c9-1fe0ffef8395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f576156d-e04e-4a94-902c-82bff4d25a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Volume volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0 (75023552-6f3f-4ac9-becf-b9bf9395e8e0): created successfully
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f576156d-e04e-4a94-902c-82bff4d25a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Flow 'volume_create_manager' (af5761bb-ab3d-4fd7-b39d-7d1c95e3dfaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-31ceedc0-45cf-4a4d-bf9f-0c3744107df4 tempest-VolumesTestJSON-1300771399 None] Created volume successfully.
Jun 24 04:22:09 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD" returned: 0 in 1.012s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Temporary image 6a968e02-4495-475e-8220-2ff19b859e62 is fetched for user 1f82eaf39d8d43138be1f8872b337e85. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b89b17-96a9-48a4-9be2-6a229976c396]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:09 devstack sudo[103273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD
Jun 24 04:22:09 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Flow 'volume_create_manager' (7c139058-b40c-4821-a4a3-215e82c21f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d615d4f-1219-4598-8122-059f6dfe1a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d615d4f-1219-4598-8122-059f6dfe1a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1965913689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b873b050-75ca-462a-a1f6-8bfac24764ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9d4f6899361492986dde5f899f27362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:10Z,use_quota=True,user_id='417faa2120db47b5bb05222301bb8782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb52c505-b98c-4c7e-9634-eed6175725db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb52c505-b98c-4c7e-9634-eed6175725db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1ae468-3c29-4e7f-bf8c-d123adabc150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1ae468-3c29-4e7f-bf8c-d123adabc150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b873b050-75ca-462a-a1f6-8bfac24764ff', 'volume_name': 'volume-b873b050-75ca-462a-a1f6-8bfac24764ff', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e918c2-74c4-40c9-a5c7-9d44f195f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e918c2-74c4-40c9-a5c7-9d44f195f187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7a8ae4-5177-4348-be1d-fb0299e3c867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:10 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Volume b873b050-75ca-462a-a1f6-8bfac24764ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b873b050-75ca-462a-a1f6-8bfac24764ff', 'volume_size': 1}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1965913689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b873b050-75ca-462a-a1f6-8bfac24764ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9d4f6899361492986dde5f899f27362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:10Z,use_quota=True,user_id='417faa2120db47b5bb05222301bb8782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Creating volume b873b050-75ca-462a-a1f6-8bfac24764ff {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:10 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:10 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:10 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff 1073741824
Jun 24 04:22:10 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:11 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff 1073741824" returned: 0 in 1.130s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:11 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff
Jun 24 04:22:11 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:12 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff" returned: 0 in 1.003s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.165s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1855035521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16020797-42fa-4032-9de9-b4e87f46dad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0584880e2ee440ea1d29efdf0fd6739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:02Z,use_quota=True,user_id='1f82eaf39d8d43138be1f8872b337e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5d51bfe-1e66-4c94-b915-a5a0e39903eb),volume_type_id=e5d51bfe-1e66-4c94-b915-a5a0e39903eb)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Creating volume 16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:12 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:12 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 1073741824
Jun 24 04:22:12 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7a8ae4-5177-4348-be1d-fb0299e3c867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b873b050-75ca-462a-a1f6-8bfac24764ff', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0741936-2561-464e-ac34-ab67af08cafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:12 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Volume volume-b873b050-75ca-462a-a1f6-8bfac24764ff (b873b050-75ca-462a-a1f6-8bfac24764ff): created successfully
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0741936-2561-464e-ac34-ab67af08cafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Flow 'volume_create_manager' (7c139058-b40c-4821-a4a3-215e82c21f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2387af50-74ed-489a-8372-cf079b35cf74 tempest-VolumesTestJSON-1300771399 None] Created volume successfully.
Jun 24 04:22:14 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 1073741824" returned: 0 in 1.283s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:14 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:22:14 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Acquiring lock "cinder-b873b050-75ca-462a-a1f6-8bfac24764ff-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Lock "cinder-b873b050-75ca-462a-a1f6-8bfac24764ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Acquiring lock "cinder-quobyte-b873b050-75ca-462a-a1f6-8bfac24764ff" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:14 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 0 in 0.895s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Lock "cinder-quobyte-b873b050-75ca-462a-a1f6-8bfac24764ff" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cdfd48-0b02-4d1c-9d51-2a67026cf1c6]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:15 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Attempting download of 6a968e02-4495-475e-8220-2ff19b859e62 ((None, [{'url': 'file:///opt/stack/data/glance/images/6a968e02-4495-475e-8220-2ff19b859e62', 'metadata': {}}])) to volume 16020797-42fa-4032-9de9-b4e87f46dad2. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:22:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[33be228c-a845-4cc3-bfad-d1345e37a824]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a968e02-4495-475e-8220-2ff19b859e62__x4gb98c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:15 devstack sudo[103298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff
Jun 24 04:22:15 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:15 devstack sudo[103299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a968e02-4495-475e-8220-2ff19b859e62__x4gb98c
Jun 24 04:22:15 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:15 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff" returned: 0 in 0.971s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:16 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff
Jun 24 04:22:16 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:16 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6a968e02-4495-475e-8220-2ff19b859e62__x4gb98c" returned: 0 in 0.947s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a968e02-4495-475e-8220-2ff19b859e62__x4gb98c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:16 devstack sudo[103310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a968e02-4495-475e-8220-2ff19b859e62__x4gb98c
Jun 24 04:22:16 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:16 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b873b050-75ca-462a-a1f6-8bfac24764ff" returned: 0 in 0.863s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Lock "cinder-quobyte-b873b050-75ca-462a-a1f6-8bfac24764ff" released by "delete_volume" :: held 1.895s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:16 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a968e02-4495-475e-8220-2ff19b859e62__x4gb98c" returned: 1 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6a968e02-4495-475e-8220-2ff19b859e62__x4gb98c' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ff242a-7704-42d9-aa8f-c1c10bf132db]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:16 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Created reservations ['5d891cfa-8bda-4c02-9d22-084149e5ec1b', '0b14ca35-b58a-46bd-bda9-aef4714ff171', 'd384506b-cf6a-4a85-b07b-e21cbaa3bab0', '3287793e-bec8-4e6e-82e5-e2bcd42bf50c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:17 devstack sudo[103316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:22:17 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:17 devstack sudo[103315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD
Jun 24 04:22:17 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Acquiring lock "cinder-75023552-6f3f-4ac9-becf-b9bf9395e8e0-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Lock "cinder-75023552-6f3f-4ac9-becf-b9bf9395e8e0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Acquiring lock "cinder-quobyte-75023552-6f3f-4ac9-becf-b9bf9395e8e0" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Lock "cinder-quobyte-75023552-6f3f-4ac9-becf-b9bf9395e8e0" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a203af-f9ce-4fe5-bce2-823e5d0c910d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:17 devstack sudo[103319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0
Jun 24 04:22:17 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:17 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.915s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:17 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Deleted volume successfully.
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] 6a968e02-4495-475e-8220-2ff19b859e62 was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:22:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-509c6c5f-f7f0-4f94-81e5-5fd0168dc07b tempest-VolumesTestJSON-1300771399 None] Lock "cinder-b873b050-75ca-462a-a1f6-8bfac24764ff-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:18 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:22:18 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:18 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0" returned: 0 in 1.355s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:18 devstack sudo[103332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0
Jun 24 04:22:18 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:19 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-75023552-6f3f-4ac9-becf-b9bf9395e8e0" returned: 0 in 1.072s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Lock "cinder-quobyte-75023552-6f3f-4ac9-becf-b9bf9395e8e0" released by "delete_volume" :: held 2.504s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:19 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Created reservations ['90157eb6-1c79-4c39-ba61-d39c85d010e9', '34dcdaeb-2408-46ee-b12f-204d72c20d5a', '1b82ebbf-c48e-465d-9060-180fb6c93c85', 'eb96e8da-e503-4525-afd2-8c7ba01a16d8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:20 devstack sudo[103344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:22:20 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Acquiring lock "cinder-907348af-65f7-4f95-aeef-5b416285e636-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Lock "cinder-907348af-65f7-4f95-aeef-5b416285e636-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Acquiring lock "cinder-quobyte-907348af-65f7-4f95-aeef-5b416285e636" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Lock "cinder-quobyte-907348af-65f7-4f95-aeef-5b416285e636" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c373545-78c9-4966-aa4f-7d5ead52e3fc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:21 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.130s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Deleted volume successfully.
Jun 24 04:22:21 devstack sudo[103347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636
Jun 24 04:22:21 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:21 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 0 in 3.211s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:21 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6a968e02-4495-475e-8220-2ff19b859e62_h5hmv5rkdevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:22:21 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Converted 112.00 MB image at 34.87 MB/s
Jun 24 04:22:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-655d0dbb-633a-4e55-bc26-25455b6d88ab tempest-VolumesTestJSON-1300771399 None] Lock "cinder-75023552-6f3f-4ac9-becf-b9bf9395e8e0-delete_volume" released by "delete_volume" :: held 4.027s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:21 devstack sudo[103349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 1G
Jun 24 04:22:21 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:22 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636" returned: 0 in 1.272s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:22 devstack sudo[103357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636
Jun 24 04:22:22 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:22 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 1G" returned: 0 in 1.162s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:22 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[90492799-ad3b-45fe-bf58-96dd972a9bc3]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:22 devstack sudo[103359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:22:22 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:23 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-907348af-65f7-4f95-aeef-5b416285e636" returned: 0 in 0.727s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Lock "cinder-quobyte-907348af-65f7-4f95-aeef-5b416285e636" released by "delete_volume" :: held 2.079s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Created reservations ['b7e1d79c-32ba-453f-922d-5ccd8e057d4b', 'c720700d-61f8-4235-9e41-039a3b627d21', 'a70eae25-4ecc-4bdf-a65e-24cfe5a96033', 'a0696a28-53a6-42e3-83ec-12045f5af328'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:23 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 0 in 0.857s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:23 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:22:23 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:23 devstack sudo[103365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:22:23 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:23 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.708s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:23 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:22:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Deleted volume successfully.
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d78025d8-15c0-4b29-927e-1051f05a4b26 tempest-VolumesTestJSON-1300771399 None] Lock "cinder-907348af-65f7-4f95-aeef-5b416285e636-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:22:24 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 1 in 0.844s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Downloaded image 6a968e02-4495-475e-8220-2ff19b859e62 ((None, [{'url': 'file:///opt/stack/data/glance/images/6a968e02-4495-475e-8220-2ff19b859e62', 'metadata': {}}])) to volume 16020797-42fa-4032-9de9-b4e87f46dad2 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Temporary image 6a968e02-4495-475e-8220-2ff19b859e62 for user 1f82eaf39d8d43138be1f8872b337e85 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Marking volume 16020797-42fa-4032-9de9-b4e87f46dad2 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Copying metadata from image 6a968e02-4495-475e-8220-2ff19b859e62 to 16020797-42fa-4032-9de9-b4e87f46dad2. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Creating volume glance metadata for volume 16020797-42fa-4032-9de9-b4e87f46dad2 backed by image 6a968e02-4495-475e-8220-2ff19b859e62 with: {'image_id': '6a968e02-4495-475e-8220-2ff19b859e62', 'image_name': 'tempest-scenario-img--317560246', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5a2deb-b7e5-42ac-81ad-8d4c58e18d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16020797-42fa-4032-9de9-b4e87f46dad2', 'volume_size': 1, 'image_id': '6a968e02-4495-475e-8220-2ff19b859e62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6a968e02-4495-475e-8220-2ff19b859e62', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--317560246', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f0584880e2ee440ea1d29efdf0fd6739', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6a968e02-4495-475e-8220-2ff19b859e62', 'created_at': datetime.datetime(2026, 6, 24, 2, 21, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 21, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6a968e02-4495-475e-8220-2ff19b859e62/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f06316d0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d8f1ff-848b-4f11-894b-af292c559a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Volume volume-16020797-42fa-4032-9de9-b4e87f46dad2 (16020797-42fa-4032-9de9-b4e87f46dad2): created successfully
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d8f1ff-848b-4f11-894b-af292c559a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Flow 'volume_create_manager' (88e28f6c-7d50-4139-81c8-c8307483c801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5dc4c3e9-eba4-47da-b59a-bf7b68381891 tempest-TestInstancesWithCinderVolumes-1689130223 None] Created volume successfully.
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Flow 'volume_create_manager' (86a8d181-c934-4b1b-9e93-33c1e5e0cbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f25efd-fb0b-4c1c-a749-209b929e8b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f25efd-fb0b-4c1c-a749-209b929e8b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1366598812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9408d6-2953-4ca8-9a5b-c83199989678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863cdbbe90574a80b9c5da21a9684fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:26Z,use_quota=True,user_id='f62b7d46ebc94745ba34524d0ad95bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2533d6-eb2c-446d-b2ae-8ba8fcb32e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d2533d6-eb2c-446d-b2ae-8ba8fcb32e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8737e4ac-b24e-4b72-8868-29f9e376a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8737e4ac-b24e-4b72-8868-29f9e376a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f9408d6-2953-4ca8-9a5b-c83199989678', 'volume_name': 'volume-3f9408d6-2953-4ca8-9a5b-c83199989678', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec65414e-01e4-428a-b54d-15c844ac3b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec65414e-01e4-428a-b54d-15c844ac3b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55792a6-3c44-40dc-ad24-c77e3d447622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:25 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Volume 3f9408d6-2953-4ca8-9a5b-c83199989678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f9408d6-2953-4ca8-9a5b-c83199989678', 'volume_size': 1}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1366598812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9408d6-2953-4ca8-9a5b-c83199989678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863cdbbe90574a80b9c5da21a9684fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:26Z,use_quota=True,user_id='f62b7d46ebc94745ba34524d0ad95bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Creating volume 3f9408d6-2953-4ca8-9a5b-c83199989678 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:25 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:22:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:25 devstack sudo[103379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678 1073741824
Jun 24 04:22:25 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Flow 'volume_create_manager' (c5e134c0-8c5e-403e-9187-5afc10891e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55add640-536b-4662-8f5f-38a976f84916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55add640-536b-4662-8f5f-38a976f84916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1221081381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d067eb-7f17-496d-81cb-959e15117a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863cdbbe90574a80b9c5da21a9684fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:26Z,use_quota=True,user_id='f62b7d46ebc94745ba34524d0ad95bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21329df3-3017-4ec5-8b10-1d472303d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21329df3-3017-4ec5-8b10-1d472303d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69ca3f0-5eca-4c36-b9ce-50e3397c9b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69ca3f0-5eca-4c36-b9ce-50e3397c9b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d067eb-7f17-496d-81cb-959e15117a80', 'volume_name': 'volume-50d067eb-7f17-496d-81cb-959e15117a80', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08de4068-eb8e-4069-9e6b-ad6e2de1121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08de4068-eb8e-4069-9e6b-ad6e2de1121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2798534-3042-4af2-acbe-b9e96479dbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Volume 50d067eb-7f17-496d-81cb-959e15117a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d067eb-7f17-496d-81cb-959e15117a80', 'volume_size': 1}
Jun 24 04:22:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:27 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678 1073741824" returned: 0 in 1.487s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:27 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678
Jun 24 04:22:27 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:28 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678" returned: 0 in 1.018s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] <== create_volume: return (2562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.567s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.041s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1221081381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d067eb-7f17-496d-81cb-959e15117a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863cdbbe90574a80b9c5da21a9684fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:26Z,use_quota=True,user_id='f62b7d46ebc94745ba34524d0ad95bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Creating volume 50d067eb-7f17-496d-81cb-959e15117a80 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:28 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55792a6-3c44-40dc-ad24-c77e3d447622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9408d6-2953-4ca8-9a5b-c83199989678', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:28 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80 1073741824
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b516e7a8-a553-440c-a181-a1e83f643210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:28 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Volume volume-3f9408d6-2953-4ca8-9a5b-c83199989678 (3f9408d6-2953-4ca8-9a5b-c83199989678): created successfully
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b516e7a8-a553-440c-a181-a1e83f643210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Flow 'volume_create_manager' (86a8d181-c934-4b1b-9e93-33c1e5e0cbf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-16402824-e7eb-4809-b645-2cbd59c5c1cb tempest-TestServerVolumeAttachmentScenario-1636759123 None] Created volume successfully.
Jun 24 04:22:30 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80 1073741824" returned: 0 in 1.624s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:30 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80
Jun 24 04:22:30 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5c665ca5-11ec-4bae-b1bf-4b3f134b626b tempest-GroupSnapshotsTest-1356704605 None] Group tempest-GroupSnapshotsTest-Group-366015215: creating
Jun 24 04:22:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5c665ca5-11ec-4bae-b1bf-4b3f134b626b tempest-GroupSnapshotsTest-1356704605 None] Group tempest-GroupSnapshotsTest-Group-366015215: created successfully
Jun 24 04:22:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5c665ca5-11ec-4bae-b1bf-4b3f134b626b tempest-GroupSnapshotsTest-1356704605 None] Create group completed successfully.
Jun 24 04:22:31 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80" returned: 0 in 0.985s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] <== create_volume: return (2673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.676s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2798534-3042-4af2-acbe-b9e96479dbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d067eb-7f17-496d-81cb-959e15117a80', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7798e013-436a-4f08-b5e6-165f7acb43ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Volume volume-50d067eb-7f17-496d-81cb-959e15117a80 (50d067eb-7f17-496d-81cb-959e15117a80): created successfully
Jun 24 04:22:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7798e013-436a-4f08-b5e6-165f7acb43ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Flow 'volume_create_manager' (c5e134c0-8c5e-403e-9187-5afc10891e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b08b72bb-e051-4ee1-9bcf-f6dca766fec0 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Created volume successfully.
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Flow 'volume_create_manager' (cbd5d810-01b3-487b-b597-73787160fedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31a0215-15af-473a-b51e-192b5ef4fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31a0215-15af-473a-b51e-192b5ef4fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-727315420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2e950e71-3b29-47ce-9c3d-1cb472ef497a,host='devstack@QuobyteHD#QuobyteHD',id=7f7aae20-4947-4930-ac92-e58768564f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee1fdbbaa74dd8b7224fc76c6f35cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:33Z,use_quota=True,user_id='b0d247a2351d470fb6271da0088f6ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f3f6024-7082-4d31-95bf-b46b3a996d0f),volume_type_id=2f3f6024-7082-4d31-95bf-b46b3a996d0f)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9596cc5-44d1-4601-a1a7-72dccff28942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9596cc5-44d1-4601-a1a7-72dccff28942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1810940a-cf19-4868-9e70-d7d01f7557c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1810940a-cf19-4868-9e70-d7d01f7557c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7aae20-4947-4930-ac92-e58768564f14', 'volume_name': 'volume-7f7aae20-4947-4930-ac92-e58768564f14', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e12d37b-4079-45eb-9224-ea39d099a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e12d37b-4079-45eb-9224-ea39d099a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4bb43f-0081-4bfb-8513-b7c16c9be8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Volume 7f7aae20-4947-4930-ac92-e58768564f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7aae20-4947-4930-ac92-e58768564f14', 'volume_size': 1}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2e950e71-3b29-47ce-9c3d-1cb472ef497a,created_at=2026-06-24T02:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-727315420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2e950e71-3b29-47ce-9c3d-1cb472ef497a,host='devstack@QuobyteHD#QuobyteHD',id=7f7aae20-4947-4930-ac92-e58768564f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee1fdbbaa74dd8b7224fc76c6f35cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:22:33Z,use_quota=True,user_id='b0d247a2351d470fb6271da0088f6ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f3f6024-7082-4d31-95bf-b46b3a996d0f),volume_type_id=2f3f6024-7082-4d31-95bf-b46b3a996d0f)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Creating volume 7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:33 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:22:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:33 devstack sudo[103429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 1073741824
Jun 24 04:22:33 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:33 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 1073741824" returned: 0 in 1.006s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:34 devstack sudo[103445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14
Jun 24 04:22:34 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:35 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14" returned: 0 in 1.073s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4bb43f-0081-4bfb-8513-b7c16c9be8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7aae20-4947-4930-ac92-e58768564f14', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9787992-28d5-4e28-8f5e-586d5dcedb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:22:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Volume volume-7f7aae20-4947-4930-ac92-e58768564f14 (7f7aae20-4947-4930-ac92-e58768564f14): created successfully
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9787992-28d5-4e28-8f5e-586d5dcedb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Flow 'volume_create_manager' (cbd5d810-01b3-487b-b597-73787160fedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:22:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a1f87b2b-a73d-44d1-afe1-bf967121b88c tempest-GroupSnapshotsTest-1356704605 None] Created volume successfully.
Jun 24 04:22:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] GroupSnapshot 05cf7c50-49f3-49ac-9b37-2b0a2e30c64d: creating.
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Group snapshot 05cf7c50-49f3-49ac-9b37-2b0a2e30c64d: creating. {{(pid=93468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Creating offline snapshot 2a3d162e-ab67-48b8-80e2-6222ec7a0dea of volume 7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:22:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290ee1f-34a9-4f6c-85de-79b2aeb39734]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:36 devstack sudo[103520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14
Jun 24 04:22:36 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:37 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14" returned: 0 in 1.317s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:37 devstack sudo[103534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea 1G
Jun 24 04:22:37 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:38 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea 1G" returned: 0 in 1.487s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7aae20-4947-4930-ac92-e58768564f14 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:38 devstack sudo[103541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7aae20-4947-4930-ac92-e58768564f14 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea
Jun 24 04:22:38 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:40 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f7aae20-4947-4930-ac92-e58768564f14 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea" returned: 0 in 1.201s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:40 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:22:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:40 devstack sudo[103560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea
Jun 24 04:22:40 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:41 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea" returned: 0 in 1.032s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:41 devstack sudo[103567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.info
Jun 24 04:22:41 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:42 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.info" returned: 0 in 0.918s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:42 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:22:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:42 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.info
Jun 24 04:22:42 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:42 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.info" returned: 0 in 0.852s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.397s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:43 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[df30c550-2141-4092-b5c9-5e1ab7c8a621]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-83023e04-fcbd-4feb-88f4-82add178e80c tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 05cf7c50-49f3-49ac-9b37-2b0a2e30c64d: created successfully
Jun 24 04:22:43 devstack sudo[103574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:22:43 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:44 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 0 in 1.073s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:44 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:22:44 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:45 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 1 in 0.886s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.038s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-2a3d162e-ab67-48b8-80e2-6222ec7a0dea-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-16020797-42fa-4032-9de9-b4e87f46dad2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd7b0844-9f2b-4568-94a5-37bf9be19720', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-2a3d162e-ab67-48b8-80e2-6222ec7a0dea-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Creating volume 54e2ec3c-47ee-4301-adea-2a0b9b8e389c from snapshot 2a3d162e-ab67-48b8-80e2-6222ec7a0dea {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] snapshot: 2a3d162e-ab67-48b8-80e2-6222ec7a0dea, volume: 54e2ec3c-47ee-4301-adea-2a0b9b8e389c,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[22738594-8618-4f70-a107-7d559daf81f4]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-c968c21a-654a-478b-85f5-8e324fd8d0b2 req-e781ba06-009f-4411-90dc-c0ed1b92863e tempest-TestInstancesWithCinderVolumes-1689130223 None] attachment_update completed successfully.
Jun 24 04:22:45 devstack sudo[103634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea
Jun 24 04:22:45 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:47 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea" returned: 0 in 1.941s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7aae20-4947-4930-ac92-e58768564f14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:22:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:22:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:22:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d27f394-4e51-4cc0-917b-1fbd16af04c5]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:47 devstack sudo[103713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14
Jun 24 04:22:47 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:48 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14" returned: 0 in 1.117s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:48 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:22:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:48 devstack sudo[103783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c
Jun 24 04:22:48 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=56,cinder:SELECT=49,cinder:INSERT=14,cinder:DELETE=7 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:22:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=59,cinder:UPDATE=58,cinder:DELETE=5,cinder:INSERT=17 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:22:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" returned: 0 in 10.032s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65995fd-e83a-4aad-bbf4-6d9f23e7edb9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:22:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:58 devstack sudo[104216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14
Jun 24 04:22:58 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:22:59 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root
Jun 24 04:22:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14" returned: 0 in 1.215s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:22:59 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:22:59 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Converted 1024.00 MB image at 102.04 MB/s
Jun 24 04:22:59 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:22:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:22:59 devstack sudo[104221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c
Jun 24 04:22:59 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:00 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" returned: 0 in 0.890s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" released by "_copy_volume_from_snapshot" :: held 15.403s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-2a3d162e-ab67-48b8-80e2-6222ec7a0dea-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" released by "_create_volume_from_snapshot" :: held 15.485s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.523s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7b923a5f-05e2-4bf9-83aa-dae638060253 tempest-GroupSnapshotsTest-1356704605 None] Create group from source-snapshot-05cf7c50-49f3-49ac-9b37-2b0a2e30c64d completed successfully.
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:01 devstack sudo[104262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:23:01 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bf8b3d-df73-48c8-840b-0a57d1d0a10d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:02 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c
Jun 24 04:23:02 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Flow 'volume_create_manager' (c1eefbbb-476b-4a6b-b225-70ea90d44606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e0a697-7c34-4fec-8950-568fa1644122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e0a697-7c34-4fec-8950-568fa1644122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-366235946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d44fc44-f138-4693-ae54-c4fdb36eac52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d72b9ea2b64b04bd224300919c2866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:02Z,use_quota=True,user_id='a0dbd63b568548839e63e35a63c353f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6925e42a-63de-4111-8061-1a2628afb8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6925e42a-63de-4111-8061-1a2628afb8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4e8b69-2ad6-42f0-b547-8b2dd3fb8679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4e8b69-2ad6-42f0-b547-8b2dd3fb8679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d44fc44-f138-4693-ae54-c4fdb36eac52', 'volume_name': 'volume-3d44fc44-f138-4693-ae54-c4fdb36eac52', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1dd54b-9540-4c7d-ae19-edb30f9ee277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1dd54b-9540-4c7d-ae19-edb30f9ee277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d65462-5719-4769-bc3e-97f0da5f3796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Volume 3d44fc44-f138-4693-ae54-c4fdb36eac52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d44fc44-f138-4693-ae54-c4fdb36eac52', 'volume_size': 1}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-366235946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d44fc44-f138-4693-ae54-c4fdb36eac52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d72b9ea2b64b04bd224300919c2866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:02Z,use_quota=True,user_id='a0dbd63b568548839e63e35a63c353f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Creating volume 3d44fc44-f138-4693-ae54-c4fdb36eac52 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:02 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:02 devstack sudo[104267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52 1073741824
Jun 24 04:23:02 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:02 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.188s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:03 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:23:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:23:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:23:03 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" returned: 0 in 1.629s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:03 devstack sudo[104273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c
Jun 24 04:23:03 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:04 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52 1073741824" returned: 0 in 1.383s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:04 devstack sudo[104279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52
Jun 24 04:23:04 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:04 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-54e2ec3c-47ee-4301-adea-2a0b9b8e389c" released by "delete_volume" :: held 2.487s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['abe5a5bc-642c-43b3-9598-cdae7892040d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:04 devstack cinder-volume[93468]: WARNING cinder.quota [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1190156076 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1190156076, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:23:04 devstack cinder-volume[93468]: WARNING cinder.quota [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1190156076 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1190156076, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['3a8d5ecd-3eb6-4ba0-a934-51fc89f0463f', 'fcbdb65a-aa41-4657-9b11-3ad830792c63', '4d13954a-a431-40b2-9fad-0eb9bfc6792c', '53b4e312-8e95-45dd-a996-e867a9b4804f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:04 devstack sudo[104283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:23:04 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:05 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d65462-5719-4769-bc3e-97f0da5f3796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d44fc44-f138-4693-ae54-c4fdb36eac52', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dc56a0-d92a-4aa4-a3ed-dd37737b62e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 05cf7c50-49f3-49ac-9b37-2b0a2e30c64d: deleting
Jun 24 04:23:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Volume volume-3d44fc44-f138-4693-ae54-c4fdb36eac52 (3d44fc44-f138-4693-ae54-c4fdb36eac52): created successfully
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89dc56a0-d92a-4aa4-a3ed-dd37737b62e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Flow 'volume_create_manager' (c1eefbbb-476b-4a6b-b225-70ea90d44606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 05cf7c50-49f3-49ac-9b37-2b0a2e30c64d: deleting {{(pid=93468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 24 04:23:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7e541545-cb85-49a9-aac9-d85f870b74c4 tempest-AttachVolumeTestJSON-474111615 None] Created volume successfully.
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-7f7aae20-4947-4930-ac92-e58768564f14" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-7f7aae20-4947-4930-ac92-e58768564f14" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-2a3d162e-ab67-48b8-80e2-6222ec7a0dea" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-2a3d162e-ab67-48b8-80e2-6222ec7a0dea" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Deleting offline snapshot 2a3d162e-ab67-48b8-80e2-6222ec7a0dea of volume 7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] snapshot_file for this snap is: volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc38913-4df1-4a3b-b20f-4ab8ab08da33]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:05 devstack sudo[104286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea
Jun 24 04:23:05 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:06 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.256s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-36f41e11-6937-4d66-888d-2c3613210c69 tempest-GroupSnapshotsTest-1356704605 None] Delete group completed successfully.
Jun 24 04:23:06 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea" returned: 0 in 1.094s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f7aae20-4947-4930-ac92-e58768564f14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:23:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a031748-6006-42c3-96fe-7394857564e1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:06 devstack sudo[104295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14
Jun 24 04:23:06 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:07 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14" returned: 0 in 0.852s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:07 devstack sudo[104300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea
Jun 24 04:23:07 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:08 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea" returned: 0 in 1.145s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:08 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea
Jun 24 04:23:08 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:09 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14.2a3d162e-ab67-48b8-80e2-6222ec7a0dea" returned: 0 in 0.934s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-2a3d162e-ab67-48b8-80e2-6222ec7a0dea" released by "_delete_snapshot" :: held 4.173s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-7f7aae20-4947-4930-ac92-e58768564f14" released by "delete_snapshot" :: held 4.224s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-99136a89-93c6-40dc-994c-8ac5892239b0 req-dbb32a6d-9efb-41d7-9ca8-99f40fd2a8f4 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-99136a89-93c6-40dc-994c-8ac5892239b0 req-dbb32a6d-9efb-41d7-9ca8-99f40fd2a8f4 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[23514b79-83ad-48c6-be47-a7a3382cdd98]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-99136a89-93c6-40dc-994c-8ac5892239b0 req-dbb32a6d-9efb-41d7-9ca8-99f40fd2a8f4 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:09 devstack cinder-volume[93468]: WARNING cinder.quota [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1190156076 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1190156076, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:23:09 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['918b3a59-1818-4d96-a0c3-11d07d71d18d', '7e27b40c-31cf-47cd-84ed-aeda3d344144', '2396b16e-3cb7-47d0-bb0b-f577c55182a3', '412910b1-db42-4e4b-8e7e-3da77bb9c49c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d4765218-dd4f-43e9-a191-506bd2669c91 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 05cf7c50-49f3-49ac-9b37-2b0a2e30c64d: deleted successfully
Jun 24 04:23:09 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52
Jun 24 04:23:09 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-7f7aae20-4947-4930-ac92-e58768564f14" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-7f7aae20-4947-4930-ac92-e58768564f14" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:10 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-99136a89-93c6-40dc-994c-8ac5892239b0 req-dbb32a6d-9efb-41d7-9ca8-99f40fd2a8f4 tempest-AttachVolumeTestJSON-474111615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-99136a89-93c6-40dc-994c-8ac5892239b0 req-dbb32a6d-9efb-41d7-9ca8-99f40fd2a8f4 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[76159419-19c2-4138-a366-41ae8ef73b73]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-99136a89-93c6-40dc-994c-8ac5892239b0 req-dbb32a6d-9efb-41d7-9ca8-99f40fd2a8f4 tempest-AttachVolumeTestJSON-474111615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-3d44fc44-f138-4693-ae54-c4fdb36eac52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20ea510f-0a11-4b48-9ace-c320136f7a3f', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:23:10 devstack sudo[104346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14
Jun 24 04:23:10 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-99136a89-93c6-40dc-994c-8ac5892239b0 req-dbb32a6d-9efb-41d7-9ca8-99f40fd2a8f4 tempest-AttachVolumeTestJSON-474111615 None] attachment_update completed successfully.
Jun 24 04:23:11 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14" returned: 0 in 0.805s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:11 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14
Jun 24 04:23:11 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:11 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7f7aae20-4947-4930-ac92-e58768564f14" returned: 0 in 0.707s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-7f7aae20-4947-4930-ac92-e58768564f14" released by "delete_volume" :: held 1.596s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['23db838b-a363-42cb-b8e2-54589fb619df'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:12 devstack cinder-volume[93468]: WARNING cinder.db.api [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1190156076']
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['efd75c32-3a18-416d-b835-19778e757c46', 'ba5ec407-416b-4781-bfda-4587cf7e507f', '45813219-5a00-40a0-9dfa-def7628327d4', '93dbf726-651d-477d-98d6-47ea0455cc55'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:12 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:23:12 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:12 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.644s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-75e8b8f6-fc23-4013-949b-30656f169a32 tempest-GroupSnapshotsTest-1356704605 None] Delete group completed successfully.
Jun 24 04:23:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-27952bc5-7cd2-4ba7-a892-c44709d52051 tempest-GroupSnapshotsTest-1356704605 None] Group tempest-GroupSnapshotsTest-Group-163837923: creating
Jun 24 04:23:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-27952bc5-7cd2-4ba7-a892-c44709d52051 tempest-GroupSnapshotsTest-1356704605 None] Group tempest-GroupSnapshotsTest-Group-163837923: created successfully
Jun 24 04:23:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-27952bc5-7cd2-4ba7-a892-c44709d52051 tempest-GroupSnapshotsTest-1356704605 None] Create group completed successfully.
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Flow 'volume_create_manager' (372d48b2-8ea4-441d-874b-b78757774433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2568224f-21e7-42aa-8643-90d027950765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2568224f-21e7-42aa-8643-90d027950765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-125662217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=11844b71-392b-499c-a6c1-1f217b190527,host='devstack@QuobyteHD#QuobyteHD',id=bc1ef6cd-89eb-4727-a0e2-868180058d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee1fdbbaa74dd8b7224fc76c6f35cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:15Z,use_quota=True,user_id='b0d247a2351d470fb6271da0088f6ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752f60c5-3bef-42f8-a340-72a3919a586b),volume_type_id=752f60c5-3bef-42f8-a340-72a3919a586b)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d217eeea-6c4a-43a0-9006-b250aa08f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d217eeea-6c4a-43a0-9006-b250aa08f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99b9da0-471a-4e28-a0d7-69702d8f3572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99b9da0-471a-4e28-a0d7-69702d8f3572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1ef6cd-89eb-4727-a0e2-868180058d34', 'volume_name': 'volume-bc1ef6cd-89eb-4727-a0e2-868180058d34', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740b0adb-a0f7-4af2-8226-82b1bd76a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740b0adb-a0f7-4af2-8226-82b1bd76a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aff120c-109c-4e17-8104-23d75e4c1d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Volume bc1ef6cd-89eb-4727-a0e2-868180058d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1ef6cd-89eb-4727-a0e2-868180058d34', 'volume_size': 1}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=11844b71-392b-499c-a6c1-1f217b190527,created_at=2026-06-24T02:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-125662217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=11844b71-392b-499c-a6c1-1f217b190527,host='devstack@QuobyteHD#QuobyteHD',id=bc1ef6cd-89eb-4727-a0e2-868180058d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee1fdbbaa74dd8b7224fc76c6f35cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:15Z,use_quota=True,user_id='b0d247a2351d470fb6271da0088f6ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752f60c5-3bef-42f8-a340-72a3919a586b),volume_type_id=752f60c5-3bef-42f8-a340-72a3919a586b)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Creating volume bc1ef6cd-89eb-4727-a0e2-868180058d34 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:15 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:15 devstack sudo[104453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 1073741824
Jun 24 04:23:15 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:15 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 1073741824" returned: 0 in 0.856s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:16 devstack sudo[104459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34
Jun 24 04:23:16 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:16 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34" returned: 0 in 0.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aff120c-109c-4e17-8104-23d75e4c1d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1ef6cd-89eb-4727-a0e2-868180058d34', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2bd013-d80e-4158-a13d-69cfef8175d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Volume volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 (bc1ef6cd-89eb-4727-a0e2-868180058d34): created successfully
Jun 24 04:23:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2bd013-d80e-4158-a13d-69cfef8175d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Flow 'volume_create_manager' (372d48b2-8ea4-441d-874b-b78757774433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-eb430d80-c941-49fa-9c0e-9bc3c1289f4b tempest-GroupSnapshotsTest-1356704605 None] Created volume successfully.
Jun 24 04:23:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-f6930612-845c-431d-9e4b-9f3395abf7f4 req-acbe6067-639f-49ec-8ff5-88afa86fed03 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-f6930612-845c-431d-9e4b-9f3395abf7f4 req-acbe6067-639f-49ec-8ff5-88afa86fed03 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b2abbc-cc35-49de-8d53-e3d341c8c4e8]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-f6930612-845c-431d-9e4b-9f3395abf7f4 req-acbe6067-639f-49ec-8ff5-88afa86fed03 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:17 devstack sudo[104509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678
Jun 24 04:23:17 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Flow 'volume_create_manager' (2f2bf15a-1148-4373-9497-d710ab549ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f78209-d567-44ef-8273-b1a545ee3df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f78209-d567-44ef-8273-b1a545ee3df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-585002630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=11844b71-392b-499c-a6c1-1f217b190527,host='devstack@QuobyteHD#QuobyteHD',id=a095f8bc-7c37-4907-8fed-0eff464fb55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee1fdbbaa74dd8b7224fc76c6f35cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:18Z,use_quota=True,user_id='b0d247a2351d470fb6271da0088f6ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752f60c5-3bef-42f8-a340-72a3919a586b),volume_type_id=752f60c5-3bef-42f8-a340-72a3919a586b)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff126008-5938-4cb5-a477-b03421ca1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff126008-5938-4cb5-a477-b03421ca1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f59fb7c-747a-4dc4-98c0-f469135edb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f59fb7c-747a-4dc4-98c0-f469135edb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a095f8bc-7c37-4907-8fed-0eff464fb55f', 'volume_name': 'volume-a095f8bc-7c37-4907-8fed-0eff464fb55f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6958ea6-1035-4789-a0e6-ed9b9b1f1ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6958ea6-1035-4789-a0e6-ed9b9b1f1ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750e6da8-ec7f-43ed-8472-14fb3cb2109f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:18 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Volume a095f8bc-7c37-4907-8fed-0eff464fb55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a095f8bc-7c37-4907-8fed-0eff464fb55f', 'volume_size': 1}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:18 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-f6930612-845c-431d-9e4b-9f3395abf7f4 req-acbe6067-639f-49ec-8ff5-88afa86fed03 tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678" returned: 0 in 0.901s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-f6930612-845c-431d-9e4b-9f3395abf7f4 req-acbe6067-639f-49ec-8ff5-88afa86fed03 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.928s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.190s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=11844b71-392b-499c-a6c1-1f217b190527,created_at=2026-06-24T02:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-585002630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=11844b71-392b-499c-a6c1-1f217b190527,host='devstack@QuobyteHD#QuobyteHD',id=a095f8bc-7c37-4907-8fed-0eff464fb55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee1fdbbaa74dd8b7224fc76c6f35cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:18Z,use_quota=True,user_id='b0d247a2351d470fb6271da0088f6ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(752f60c5-3bef-42f8-a340-72a3919a586b),volume_type_id=752f60c5-3bef-42f8-a340-72a3919a586b)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Creating volume a095f8bc-7c37-4907-8fed-0eff464fb55f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:18 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:18 devstack sudo[104515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f 1073741824
Jun 24 04:23:18 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-f6930612-845c-431d-9e4b-9f3395abf7f4 req-acbe6067-639f-49ec-8ff5-88afa86fed03 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-3f9408d6-2953-4ca8-9a5b-c83199989678', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae3e832d-1fdf-40ac-a52a-560dc90ff474', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:23:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-f6930612-845c-431d-9e4b-9f3395abf7f4 req-acbe6067-639f-49ec-8ff5-88afa86fed03 tempest-TestServerVolumeAttachmentScenario-1636759123 None] attachment_update completed successfully.
Jun 24 04:23:19 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f 1073741824" returned: 0 in 0.845s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:19 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f
Jun 24 04:23:19 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:20 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f" returned: 0 in 0.739s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750e6da8-ec7f-43ed-8472-14fb3cb2109f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a095f8bc-7c37-4907-8fed-0eff464fb55f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac550b3-7675-4ebb-b8da-b31cbe81cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:20 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Volume volume-a095f8bc-7c37-4907-8fed-0eff464fb55f (a095f8bc-7c37-4907-8fed-0eff464fb55f): created successfully
Jun 24 04:23:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac550b3-7675-4ebb-b8da-b31cbe81cb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Flow 'volume_create_manager' (2f2bf15a-1148-4373-9497-d710ab549ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a540ed74-ef68-4400-ae7f-078c8f286c05 tempest-GroupSnapshotsTest-1356704605 None] Created volume successfully.
Jun 24 04:23:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-43a96229-50ca-443f-920c-0e37b6825e33 tempest-GroupSnapshotsTest-1356704605 None] Update group completed successfully.
Jun 24 04:23:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8e23a57b-c016-4ecb-aab2-6477e6ea6e2e tempest-GroupSnapshotsTest-1356704605 None] Update group completed successfully.
Jun 24 04:23:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a843a61a-2700-43ab-b725-baf55247b985 tempest-GroupSnapshotsTest-1356704605 None] Update group completed successfully.
Jun 24 04:23:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-861960ae-a634-438c-b5c8-2859d554ef8d tempest-GroupSnapshotsTest-1356704605 None] Update group completed successfully.
Jun 24 04:23:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] GroupSnapshot 8daabeaa-e1bd-4364-9f20-78ff323d8705: creating.
Jun 24 04:23:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Group snapshot 8daabeaa-e1bd-4364-9f20-78ff323d8705: creating. {{(pid=93468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 24 04:23:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Creating offline snapshot 6cd77527-a534-48fe-be14-40683127771a of volume a095f8bc-7c37-4907-8fed-0eff464fb55f {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:23:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b7df3-3a15-4be6-b72a-5d3480bcb848]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:25 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f
Jun 24 04:23:25 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:26 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f" returned: 0 in 0.787s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:26 devstack sudo[104564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a 1G
Jun 24 04:23:26 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:27 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a 1G" returned: 0 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a095f8bc-7c37-4907-8fed-0eff464fb55f -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:27 devstack sudo[104576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a095f8bc-7c37-4907-8fed-0eff464fb55f -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a
Jun 24 04:23:27 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:28 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a095f8bc-7c37-4907-8fed-0eff464fb55f -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a" returned: 0 in 0.791s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:28 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:23:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:28 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a
Jun 24 04:23:28 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7be51de9-6094-4ce5-928a-1bee432509db req-374a017e-efa1-476e-9910-48ee9af61218 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:29 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a" returned: 0 in 0.894s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:29 devstack sudo[104640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.info
Jun 24 04:23:29 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:30 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.info" returned: 0 in 0.995s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:30 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:23:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:30 devstack sudo[104688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.info
Jun 24 04:23:30 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:30 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.info" returned: 0 in 0.742s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.184s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Creating offline snapshot 71ebfaf3-3ad5-4628-8666-dd67db290c04 of volume bc1ef6cd-89eb-4727-a0e2-868180058d34 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:23:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d963f344-937b-4681-bffa-c32ac0837130]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:31 devstack sudo[104694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34
Jun 24 04:23:31 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ada38596-cdab-43b4-9655-66b221d93def req-fe9b9607-7fe9-4f0b-ac13-22f8df83ad75 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:31 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34" returned: 0 in 0.943s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:32 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 1G
Jun 24 04:23:32 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:32 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 1G" returned: 0 in 0.875s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:32 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04
Jun 24 04:23:32 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:33 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04" returned: 0 in 0.728s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:33 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:23:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:33 devstack sudo[104721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04
Jun 24 04:23:33 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:34 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04" returned: 0 in 0.668s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:34 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.info
Jun 24 04:23:34 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:34 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.info" returned: 0 in 0.679s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:34 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:23:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:35 devstack sudo[104728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.info
Jun 24 04:23:35 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:35 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.info" returned: 0 in 0.657s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.657s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7be51de9-6094-4ce5-928a-1bee432509db req-374a017e-efa1-476e-9910-48ee9af61218 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.218s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed8cb7-a03c-4d26-a2c8-88138f5e8d13]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7be51de9-6094-4ce5-928a-1bee432509db req-374a017e-efa1-476e-9910-48ee9af61218 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:35 devstack sudo[104731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80
Jun 24 04:23:35 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:36 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7be51de9-6094-4ce5-928a-1bee432509db req-374a017e-efa1-476e-9910-48ee9af61218 tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7be51de9-6094-4ce5-928a-1bee432509db req-374a017e-efa1-476e-9910-48ee9af61218 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.789s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ada38596-cdab-43b4-9655-66b221d93def req-fe9b9607-7fe9-4f0b-ac13-22f8df83ad75 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.614s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-19e19833-5b3e-489f-b89b-9ba4149fb526 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 8daabeaa-e1bd-4364-9f20-78ff323d8705: created successfully
Jun 24 04:23:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef21147e-7d79-46d7-a3b4-173d406cf23a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-ada38596-cdab-43b4-9655-66b221d93def req-fe9b9607-7fe9-4f0b-ac13-22f8df83ad75 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-7be51de9-6094-4ce5-928a-1bee432509db req-374a017e-efa1-476e-9910-48ee9af61218 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-50d067eb-7f17-496d-81cb-959e15117a80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c669da8-9f0c-43e5-bcfd-902d70c47cc9', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:23:36 devstack sudo[104736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc
Jun 24 04:23:36 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-7be51de9-6094-4ce5-928a-1bee432509db req-374a017e-efa1-476e-9910-48ee9af61218 tempest-TestServerVolumeAttachmentScenario-1636759123 None] attachment_update completed successfully.
Jun 24 04:23:37 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-ada38596-cdab-43b4-9655-66b221d93def req-fe9b9607-7fe9-4f0b-ac13-22f8df83ad75 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc" returned: 0 in 0.845s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-ada38596-cdab-43b4-9655-66b221d93def req-fe9b9607-7fe9-4f0b-ac13-22f8df83ad75 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.867s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-ada38596-cdab-43b4-9655-66b221d93def req-fe9b9607-7fe9-4f0b-ac13-22f8df83ad75 tempest-TestInstancesWithCinderVolumes-1689130223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-a2607e4f-d3b0-43f9-8754-03deb77112cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e65cbb1d-a5ca-47ea-a629-02284ad15fd5', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:23:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-ada38596-cdab-43b4-9655-66b221d93def req-fe9b9607-7fe9-4f0b-ac13-22f8df83ad75 tempest-TestInstancesWithCinderVolumes-1689130223 None] attachment_update completed successfully.
Jun 24 04:23:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 8daabeaa-e1bd-4364-9f20-78ff323d8705: deleting
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 8daabeaa-e1bd-4364-9f20-78ff323d8705: deleting {{(pid=93468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-a095f8bc-7c37-4907-8fed-0eff464fb55f" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-a095f8bc-7c37-4907-8fed-0eff464fb55f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-6cd77527-a534-48fe-be14-40683127771a" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-6cd77527-a534-48fe-be14-40683127771a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Deleting offline snapshot 6cd77527-a534-48fe-be14-40683127771a of volume a095f8bc-7c37-4907-8fed-0eff464fb55f {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:23:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] snapshot_file for this snap is: volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:23:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b19d937-e0ca-47e1-88a1-c02d8433e53f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:38 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a
Jun 24 04:23:38 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:38 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a" returned: 0 in 0.826s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a095f8bc-7c37-4907-8fed-0eff464fb55f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:23:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[41449f00-fcea-4155-b5d9-758b14eef589]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:38 devstack sudo[104759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f
Jun 24 04:23:38 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:39 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:39 devstack sudo[104764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a
Jun 24 04:23:39 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:40 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:40 devstack sudo[104769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a
Jun 24 04:23:40 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:41 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f.6cd77527-a534-48fe-be14-40683127771a" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-6cd77527-a534-48fe-be14-40683127771a" released by "_delete_snapshot" :: held 3.234s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-a095f8bc-7c37-4907-8fed-0eff464fb55f" released by "delete_snapshot" :: held 3.264s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-bc1ef6cd-89eb-4727-a0e2-868180058d34" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-bc1ef6cd-89eb-4727-a0e2-868180058d34" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-71ebfaf3-3ad5-4628-8666-dd67db290c04" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-71ebfaf3-3ad5-4628-8666-dd67db290c04" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Deleting offline snapshot 71ebfaf3-3ad5-4628-8666-dd67db290c04 of volume bc1ef6cd-89eb-4727-a0e2-868180058d34 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] snapshot_file for this snap is: volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1342e0e2-b9a7-4dfc-b58e-0f26410abebe]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:41 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04
Jun 24 04:23:41 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:42 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04" returned: 0 in 0.937s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc1ef6cd-89eb-4727-a0e2-868180058d34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:23:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50632e3-15f0-4b06-b997-a600c0006ac5]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:42 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34
Jun 24 04:23:42 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:43 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34" returned: 0 in 0.850s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:43 devstack sudo[104788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04
Jun 24 04:23:43 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-6566ad5a-61cf-4605-92a6-dd586310daa3 req-cca51ece-be5a-4659-9115-09b7861a211d tempest-TestServerVolumeAttachmentScenario-1636759123 None] Terminate volume connection completed successfully.
Jun 24 04:23:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-6566ad5a-61cf-4605-92a6-dd586310daa3 req-cca51ece-be5a-4659-9115-09b7861a211d tempest-TestServerVolumeAttachmentScenario-1636759123 None] Deleting attachment 6c669da8-9f0c-43e5-bcfd-902d70c47cc9. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:23:43 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04" returned: 0 in 0.824s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:43 devstack sudo[104803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04
Jun 24 04:23:43 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:44 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34.71ebfaf3-3ad5-4628-8666-dd67db290c04" returned: 0 in 0.626s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-71ebfaf3-3ad5-4628-8666-dd67db290c04" released by "_delete_snapshot" :: held 3.340s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-bc1ef6cd-89eb-4727-a0e2-868180058d34" released by "delete_snapshot" :: held 3.360s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:44 devstack cinder-volume[93468]: WARNING cinder.quota [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-752978941 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-752978941, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:23:44 devstack cinder-volume[93468]: WARNING cinder.quota [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-752978941 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-752978941, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:23:44 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['e17547d3-53f5-4d9a-8a94-e167c25c8d0a', '1b5be3aa-ecef-440d-a08b-d6845f5ab4d8', 'c4a7b81a-f10a-4c6e-8192-eac0c98b32ea', 'efb90be8-05e6-437f-949e-d8f61ab98920'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:44 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['2c2684b1-9404-4965-8262-3de1befc23ff', '003171e5-328d-49a6-930e-d904d7c9a3db', '27fc523f-50a0-46a0-aa7a-ac58580a7b40', '2f09b548-fba3-439d-aae4-7e6e4e3884d8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-44e7b379-7658-4b8d-a2cf-8195c26c08a2 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 8daabeaa-e1bd-4364-9f20-78ff323d8705: deleted successfully
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-a095f8bc-7c37-4907-8fed-0eff464fb55f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-a095f8bc-7c37-4907-8fed-0eff464fb55f" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2a4ed7-fe2f-46db-a451-e7a4f201a061]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:46 devstack sudo[104844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f
Jun 24 04:23:46 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-10f51157-550c-4ab2-aa3f-8ffb7d18f224 req-5e898a77-2d7c-4307-9fc6-8cac8967a0ec tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-10f51157-550c-4ab2-aa3f-8ffb7d18f224 req-5e898a77-2d7c-4307-9fc6-8cac8967a0ec tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619cf4e-6bb3-437c-8615-e9fafbcf1e96]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-10f51157-550c-4ab2-aa3f-8ffb7d18f224 req-5e898a77-2d7c-4307-9fc6-8cac8967a0ec tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:46 devstack sudo[104853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f
Jun 24 04:23:46 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:46 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f" returned: 0 in 0.844s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:46 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f
Jun 24 04:23:46 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:47 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-10f51157-550c-4ab2-aa3f-8ffb7d18f224 req-5e898a77-2d7c-4307-9fc6-8cac8967a0ec tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f" returned: 0 in 0.790s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-10f51157-550c-4ab2-aa3f-8ffb7d18f224 req-5e898a77-2d7c-4307-9fc6-8cac8967a0ec tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-10f51157-550c-4ab2-aa3f-8ffb7d18f224 req-5e898a77-2d7c-4307-9fc6-8cac8967a0ec tempest-TestInstancesWithCinderVolumes-1689130223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-445a1125-7647-422a-adfb-f92b2f2b7b7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f86c923b-eb41-4be9-a473-de278e1f4a1e', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:23:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-10f51157-550c-4ab2-aa3f-8ffb7d18f224 req-5e898a77-2d7c-4307-9fc6-8cac8967a0ec tempest-TestInstancesWithCinderVolumes-1689130223 None] attachment_update completed successfully.
Jun 24 04:23:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-04821775-a803-4002-9467-b7f511823267 req-09e8a83b-498d-43b4-b8eb-1f3e10635eab tempest-TestServerVolumeAttachmentScenario-1636759123 None] Terminate volume connection completed successfully.
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-04821775-a803-4002-9467-b7f511823267 req-09e8a83b-498d-43b4-b8eb-1f3e10635eab tempest-TestServerVolumeAttachmentScenario-1636759123 None] Deleting attachment ae3e832d-1fdf-40ac-a52a-560dc90ff474. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:23:47 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a095f8bc-7c37-4907-8fed-0eff464fb55f" returned: 0 in 0.689s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-a095f8bc-7c37-4907-8fed-0eff464fb55f" released by "delete_volume" :: held 1.606s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-bc1ef6cd-89eb-4727-a0e2-868180058d34" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-bc1ef6cd-89eb-4727-a0e2-868180058d34" acquired by "delete_volume" :: waited 0.012s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bcfb73-b197-4ed8-bdfa-59f35ed4884a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:47 devstack sudo[104871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34
Jun 24 04:23:47 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:48 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34" returned: 0 in 0.798s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:48 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34
Jun 24 04:23:48 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:49 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bc1ef6cd-89eb-4727-a0e2-868180058d34" returned: 0 in 0.687s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-bc1ef6cd-89eb-4727-a0e2-868180058d34" released by "delete_volume" :: held 1.545s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['4dc88aa4-b269-4320-b54c-044185eccb72'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:49 devstack cinder-volume[93468]: WARNING cinder.quota [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-752978941 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-752978941, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['0e85ae23-c92f-4912-af73-5033f8910586', 'cd9e33e8-e1e5-4393-b797-656da23eaf04', '4b5dbb8b-90eb-43a6-9133-d830dbd42b6a', '4c95b446-cde5-49a1-9c89-2cf602e9aa9f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['a029036e-23c7-40d8-a284-dcd6b641a380', 'a5fcfa41-ef91-4744-82c8-585096428a23', 'f000275c-3a9d-40b9-b05a-a66c430a3fb9', 'da771cb3-6b85-41d5-97d8-8777b7b7da1c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:49 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:23:49 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:50 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.706s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:50 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:23:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4845ab7a-e465-4832-a04c-fd81365cdbaa tempest-GroupSnapshotsTest-1356704605 None] Delete group completed successfully.
Jun 24 04:23:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-986a8ed5-b345-4bc8-bd31-f6fc20cd5b50 tempest-GroupSnapshotsTest-1356704605 None] Group tempest-GroupSnapshotsTest-Group-1179185283: creating
Jun 24 04:23:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-986a8ed5-b345-4bc8-bd31-f6fc20cd5b50 tempest-GroupSnapshotsTest-1356704605 None] Group tempest-GroupSnapshotsTest-Group-1179185283: created successfully
Jun 24 04:23:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-986a8ed5-b345-4bc8-bd31-f6fc20cd5b50 tempest-GroupSnapshotsTest-1356704605 None] Create group completed successfully.
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Flow 'volume_create_manager' (26033740-40d0-4b16-8bdd-7aa04fbec401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e971cf57-bdda-4ce6-a18f-ec8e5880ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e971cf57-bdda-4ce6-a18f-ec8e5880ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-828498874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8c369ea7-54f9-4d6c-9166-3b68007a8dbf,host='devstack@QuobyteHD#QuobyteHD',id=daab6c53-d066-4615-952e-7923335ddabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee1fdbbaa74dd8b7224fc76c6f35cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:53Z,use_quota=True,user_id='b0d247a2351d470fb6271da0088f6ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(862d8fc2-0aa3-47c3-a502-8b7d334be6d7),volume_type_id=862d8fc2-0aa3-47c3-a502-8b7d334be6d7)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b565fdb-992a-4cc3-8dd1-be432b5b3966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b565fdb-992a-4cc3-8dd1-be432b5b3966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee79a3e7-5482-40a2-ad4a-516d9088d3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee79a3e7-5482-40a2-ad4a-516d9088d3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daab6c53-d066-4615-952e-7923335ddabc', 'volume_name': 'volume-daab6c53-d066-4615-952e-7923335ddabc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b08621-fd6d-4229-b294-c5292a73e1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b08621-fd6d-4229-b294-c5292a73e1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee14ae33-2b52-4f0e-83d7-4f16a2094895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Volume daab6c53-d066-4615-952e-7923335ddabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daab6c53-d066-4615-952e-7923335ddabc', 'volume_size': 1}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8c369ea7-54f9-4d6c-9166-3b68007a8dbf,created_at=2026-06-24T02:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-828498874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8c369ea7-54f9-4d6c-9166-3b68007a8dbf,host='devstack@QuobyteHD#QuobyteHD',id=daab6c53-d066-4615-952e-7923335ddabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ee1fdbbaa74dd8b7224fc76c6f35cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:23:53Z,use_quota=True,user_id='b0d247a2351d470fb6271da0088f6ad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(862d8fc2-0aa3-47c3-a502-8b7d334be6d7),volume_type_id=862d8fc2-0aa3-47c3-a502-8b7d334be6d7)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Creating volume daab6c53-d066-4615-952e-7923335ddabc {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:23:53 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:23:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:53 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc 1073741824
Jun 24 04:23:53 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:54 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc 1073741824" returned: 0 in 0.969s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:54 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc
Jun 24 04:23:54 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-c7fc0450-05bf-447b-9b9f-f31fb3d73222 req-1d0bb365-1f28-44c9-8046-987e86b8e2f0 tempest-AttachVolumeTestJSON-474111615 None] Terminate volume connection completed successfully.
Jun 24 04:23:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-c7fc0450-05bf-447b-9b9f-f31fb3d73222 req-1d0bb365-1f28-44c9-8046-987e86b8e2f0 tempest-AttachVolumeTestJSON-474111615 None] Deleting attachment 20ea510f-0a11-4b48-9ace-c320136f7a3f. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:23:55 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc" returned: 0 in 0.713s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee14ae33-2b52-4f0e-83d7-4f16a2094895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daab6c53-d066-4615-952e-7923335ddabc', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a76b6b-3ab3-4a54-9cfb-bae563cf923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:23:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Volume volume-daab6c53-d066-4615-952e-7923335ddabc (daab6c53-d066-4615-952e-7923335ddabc): created successfully
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a76b6b-3ab3-4a54-9cfb-bae563cf923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Flow 'volume_create_manager' (26033740-40d0-4b16-8bdd-7aa04fbec401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:23:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8cbaadc6-e5a9-4126-9243-c1eca2d7335e tempest-GroupSnapshotsTest-1356704605 None] Created volume successfully.
Jun 24 04:23:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] GroupSnapshot 5f9e4b9e-6661-46e2-b1be-b6ac04c338fb: creating.
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=92,cinder:SELECT=106,cinder:INSERT=22,cinder:DELETE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=86,cinder:SELECT=113,cinder:INSERT=15,cinder:DELETE=2 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Group snapshot 5f9e4b9e-6661-46e2-b1be-b6ac04c338fb: creating. {{(pid=93468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Creating offline snapshot 36ad58a9-a56b-422d-96d8-9418604d579f of volume daab6c53-d066-4615-952e-7923335ddabc {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b179a6b-c3ca-44dc-9723-12efe51c4218]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:55 devstack sudo[104981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc
Jun 24 04:23:55 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:56 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:56 devstack sudo[104989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f 1G
Jun 24 04:23:56 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-b53f2d57-301b-4557-85d1-5534f58525a7 req-20bc9f9c-0dbd-4df1-96d8-159a396ec5bf tempest-TestInstancesWithCinderVolumes-1689130223 None] Terminate volume connection completed successfully.
Jun 24 04:23:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-b53f2d57-301b-4557-85d1-5534f58525a7 req-20bc9f9c-0dbd-4df1-96d8-159a396ec5bf tempest-TestInstancesWithCinderVolumes-1689130223 None] Deleting attachment e65cbb1d-a5ca-47ea-a629-02284ad15fd5. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:23:57 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f 1G" returned: 0 in 1.190s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daab6c53-d066-4615-952e-7923335ddabc -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:57 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daab6c53-d066-4615-952e-7923335ddabc -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f
Jun 24 04:23:57 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:58 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daab6c53-d066-4615-952e-7923335ddabc -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:58 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "cinder-50d067eb-7f17-496d-81cb-959e15117a80-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:58 devstack sudo[105044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f
Jun 24 04:23:58 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "cinder-50d067eb-7f17-496d-81cb-959e15117a80-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "cinder-quobyte-50d067eb-7f17-496d-81cb-959e15117a80" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "cinder-quobyte-50d067eb-7f17-496d-81cb-959e15117a80" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "cinder-a2607e4f-d3b0-43f9-8754-03deb77112cc-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[66254bab-7163-4611-9d91-e111c678a970]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-a2607e4f-d3b0-43f9-8754-03deb77112cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "cinder-quobyte-a2607e4f-d3b0-43f9-8754-03deb77112cc" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-quobyte-a2607e4f-d3b0-43f9-8754-03deb77112cc" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6cda7-beb9-415a-8e46-6c15398036ef]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:23:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:58 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80
Jun 24 04:23:58 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:59 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc
Jun 24 04:23:59 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:59 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f" returned: 0 in 0.849s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:59 devstack sudo[105055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.info
Jun 24 04:23:59 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:59 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80" returned: 0 in 1.078s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:59 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Jun 24 04:23:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc" returned: 0 in 0.997s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:23:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:23:59 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80
Jun 24 04:23:59 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:23:59 devstack sudo[105064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc
Jun 24 04:23:59 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:00 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.info" returned: 0 in 0.938s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:00 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:00 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.info
Jun 24 04:24:00 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:00 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a2607e4f-d3b0-43f9-8754-03deb77112cc" returned: 0 in 0.791s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-quobyte-a2607e4f-d3b0-43f9-8754-03deb77112cc" released by "delete_volume" :: held 1.844s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:00 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-50d067eb-7f17-496d-81cb-959e15117a80" returned: 0 in 0.882s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:00 devstack cinder-volume[93468]: WARNING cinder.quota [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615123284-869983026 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615123284-869983026, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:00 devstack cinder-volume[93468]: WARNING cinder.quota [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615123284-869983026 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615123284-869983026, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "cinder-quobyte-50d067eb-7f17-496d-81cb-959e15117a80" released by "delete_volume" :: held 2.024s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Created reservations ['99a9fc66-063e-4fd8-beff-8f5514380bca', '1a89ff23-77f3-4840-9af0-e1578d121208', 'a6288a6a-d176-4133-bff2-602d4153fa1c', '68885443-bc53-4dca-baf8-077b35680b10'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Created reservations ['f2ddd065-51b0-4e3d-b0b5-370fc222045f', 'c4b014d2-6369-42fe-8a9b-fc04c7f489e6', '71c21b27-f787-4e58-b2f0-1c778784b7b9', 'ca9a8a73-94a6-49a0-bd51-87a873ad0163'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:00 devstack sudo[105072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:00 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:01 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:01 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:01 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.info" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.477s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dc78a666-ff81-4f2f-9f43-15aa916d46f8 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 5f9e4b9e-6661-46e2-b1be-b6ac04c338fb: created successfully
Jun 24 04:24:01 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deleted volume successfully.
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fd8ac9f2-e2f0-403c-8e66-dd60edf43ad3 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-a2607e4f-d3b0-43f9-8754-03deb77112cc-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:01 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:01 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:01 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.869s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Deleted volume successfully.
Jun 24 04:24:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8be2923e-c265-4f8f-bb52-cbbc0fd12613 tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "cinder-50d067eb-7f17-496d-81cb-959e15117a80-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "cinder-3f9408d6-2953-4ca8-9a5b-c83199989678-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "cinder-3f9408d6-2953-4ca8-9a5b-c83199989678-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "cinder-quobyte-3f9408d6-2953-4ca8-9a5b-c83199989678" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "cinder-quobyte-3f9408d6-2953-4ca8-9a5b-c83199989678" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[414338c3-3e2f-4438-a505-cb914e021bc9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 5f9e4b9e-6661-46e2-b1be-b6ac04c338fb: deleting
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 5f9e4b9e-6661-46e2-b1be-b6ac04c338fb: deleting {{(pid=93468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 24 04:24:02 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678
Jun 24 04:24:02 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-daab6c53-d066-4615-952e-7923335ddabc" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-daab6c53-d066-4615-952e-7923335ddabc" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-36ad58a9-a56b-422d-96d8-9418604d579f" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-36ad58a9-a56b-422d-96d8-9418604d579f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Deleting offline snapshot 36ad58a9-a56b-422d-96d8-9418604d579f of volume daab6c53-d066-4615-952e-7923335ddabc {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] snapshot_file for this snap is: volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee3f389-4867-4b0a-9976-5a4295417084]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:02 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.920s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:24:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:24:02 devstack sudo[105106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f
Jun 24 04:24:02 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:03 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678" returned: 0 in 1.108s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:03 devstack sudo[105111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678
Jun 24 04:24:03 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:03 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f" returned: 0 in 0.916s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daab6c53-d066-4615-952e-7923335ddabc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:24:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb65a686-4e00-447c-b601-b90ba40d003a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:03 devstack sudo[105116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc
Jun 24 04:24:03 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:04 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f9408d6-2953-4ca8-9a5b-c83199989678" returned: 0 in 0.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "cinder-quobyte-3f9408d6-2953-4ca8-9a5b-c83199989678" released by "delete_volume" :: held 1.892s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Created reservations ['2b450511-10ce-42d9-ba14-8ae81fca5755', '8948e9fc-82bd-4cb6-aa3f-3ff6569cfa37', 'aa340520-9313-4e1d-beb9-da76c28fbed5', '9a85528f-b164-4280-9c32-1fd88a0ca541'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:04 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:04 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:04 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:04 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f
Jun 24 04:24:04 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-44ace5a6-4f89-4c4a-9a2f-9bed508ad167 req-db351d1a-5f35-491f-a7a5-0a3b036862ae tempest-TestInstancesWithCinderVolumes-1689130223 None] Terminate volume connection completed successfully.
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-44ace5a6-4f89-4c4a-9a2f-9bed508ad167 req-db351d1a-5f35-491f-a7a5-0a3b036862ae tempest-TestInstancesWithCinderVolumes-1689130223 None] Deleting attachment f86c923b-eb41-4be9-a473-de278e1f4a1e. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:24:04 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.699s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Deleted volume successfully.
Jun 24 04:24:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-19a6f7a0-40ef-425b-b465-5f05fa79c37c tempest-TestServerVolumeAttachmentScenario-1636759123 None] Lock "cinder-3f9408d6-2953-4ca8-9a5b-c83199989678-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:05 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f" returned: 0 in 0.819s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:05 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f
Jun 24 04:24:05 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:05 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc.36ad58a9-a56b-422d-96d8-9418604d579f" returned: 0 in 0.698s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-36ad58a9-a56b-422d-96d8-9418604d579f" released by "_delete_snapshot" :: held 3.451s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-daab6c53-d066-4615-952e-7923335ddabc" released by "delete_snapshot" :: held 3.479s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:06 devstack cinder-volume[93468]: WARNING cinder.quota [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-977126015 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-977126015, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:06 devstack cinder-volume[93468]: WARNING cinder.quota [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-977126015 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-977126015, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:06 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['ec302849-de38-4cee-8956-58dbcc10c11b', 'e9c97fa0-b53a-4be1-9bf6-aaa57f43582c', 'bd4a1e18-0505-42fd-b5bb-32b811f7e5db', 'd6a2245f-5b12-4b75-8f8c-8e26818ff9ee'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b251a0f7-c9d8-4adf-a315-668a5d5f7e20 tempest-GroupSnapshotsTest-1356704605 None] group_snapshot 5f9e4b9e-6661-46e2-b1be-b6ac04c338fb: deleted successfully
Jun 24 04:24:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "cinder-445a1125-7647-422a-adfb-f92b2f2b7b7f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-445a1125-7647-422a-adfb-f92b2f2b7b7f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "cinder-quobyte-445a1125-7647-422a-adfb-f92b2f2b7b7f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-quobyte-445a1125-7647-422a-adfb-f92b2f2b7b7f" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75d4d68-4091-4428-9777-e4b0243fdabf]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:06 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f
Jun 24 04:24:06 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "cinder-quobyte-daab6c53-d066-4615-952e-7923335ddabc" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-daab6c53-d066-4615-952e-7923335ddabc" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cf7f28-568f-46ad-91f5-509201a7ce44]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:07 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f" returned: 0 in 1.118s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:07 devstack sudo[105159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f
Jun 24 04:24:07 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:07 devstack sudo[105156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc
Jun 24 04:24:07 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:08 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-445a1125-7647-422a-adfb-f92b2f2b7b7f" returned: 0 in 0.931s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-quobyte-445a1125-7647-422a-adfb-f92b2f2b7b7f" released by "delete_volume" :: held 2.123s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:08 devstack cinder-volume[93468]: WARNING cinder.quota [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-501770610-1447317925 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-501770610-1447317925, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:08 devstack cinder-volume[93468]: WARNING cinder.quota [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-501770610-1447317925 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-501770610-1447317925, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Created reservations ['2c292b00-dbb4-458d-8ae9-1e4d74c84464', 'a01d27cd-57d1-418b-b29c-5744d848d9c8', 'eb0e1ec7-49f2-4e1d-8ee1-4524d8cc8b4a', '9dd6a1b1-b600-48d0-b807-b2369a9cfc70'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:08 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:08 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:09 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc" returned: 0 in 1.597s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:09 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc
Jun 24 04:24:09 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:10 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-daab6c53-d066-4615-952e-7923335ddabc" returned: 0 in 1.290s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Lock "cinder-quobyte-daab6c53-d066-4615-952e-7923335ddabc" released by "delete_volume" :: held 2.993s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:10 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['70a8b6bf-93d5-4a8c-b806-4b87103b687b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:10 devstack cinder-volume[93468]: WARNING cinder.quota [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-977126015 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-977126015, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:10 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Created reservations ['abb7a0c6-3288-412e-a310-d35adc47b67b', '57b37139-ff5d-4d9f-a0a1-fd54362f1ed2', '8a8bb183-44cb-4073-be64-21e6c9278f31', '5a015d65-23f3-46e6-a051-247e350af4ee'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:10 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.975s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:10 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deleted volume successfully.
Jun 24 04:24:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-21bc6d6d-e9d7-44e1-968f-c5c46ae995f8 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-445a1125-7647-422a-adfb-f92b2f2b7b7f-delete_volume" released by "delete_volume" :: held 4.598s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:11 devstack sudo[105255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:11 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:12 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.791s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:12 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1447135d-9667-4142-8a73-7784a521aaa4 tempest-GroupSnapshotsTest-1356704605 None] Delete group completed successfully.
Jun 24 04:24:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-31ddccf8-340e-40e4-87a3-6ab99bd505c5 req-d5fdc5bd-b05f-4e39-8fc9-1bf86e7e29cd tempest-TestInstancesWithCinderVolumes-1689130223 None] Terminate volume connection completed successfully.
Jun 24 04:24:18 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-31ddccf8-340e-40e4-87a3-6ab99bd505c5 req-d5fdc5bd-b05f-4e39-8fc9-1bf86e7e29cd tempest-TestInstancesWithCinderVolumes-1689130223 None] Deleting attachment fd7b0844-9f2b-4568-94a5-37bf9be19720. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:24:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "cinder-16020797-42fa-4032-9de9-b4e87f46dad2-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-16020797-42fa-4032-9de9-b4e87f46dad2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "cinder-quobyte-16020797-42fa-4032-9de9-b4e87f46dad2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-quobyte-16020797-42fa-4032-9de9-b4e87f46dad2" acquired by "delete_volume" :: waited 0.054s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:22 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae57731-caa2-427c-ac03-78a86b1d87d1]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:22 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:24:22 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:23 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 0 in 1.218s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:23 devstack sudo[105326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:24:23 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:24 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 1 in 0.962s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:24:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:24 devstack sudo[105334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2
Jun 24 04:24:24 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:25 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-16020797-42fa-4032-9de9-b4e87f46dad2" returned: 0 in 0.801s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-quobyte-16020797-42fa-4032-9de9-b4e87f46dad2" released by "delete_volume" :: held 3.101s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:25 devstack cinder-volume[93468]: WARNING cinder.quota [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2070353892-699333274 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2070353892-699333274, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:25 devstack cinder-volume[93468]: WARNING cinder.quota [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2070353892-699333274 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2070353892-699333274, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Created reservations ['3c610977-de9d-4c17-8da0-9847c3369f09', '3e905459-7040-4843-abb0-f5a66cb05c59', '4085bf17-79d0-41ba-b8b2-5edfc03614f8', 'f30ab337-1cd1-4ae1-abbc-fe9e3e5b76e5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:25 devstack sudo[105345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:25 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:26 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:26 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Deleted volume successfully.
Jun 24 04:24:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5a0d20d1-6436-419c-8ff7-78b760271509 tempest-TestInstancesWithCinderVolumes-1689130223 None] Lock "cinder-16020797-42fa-4032-9de9-b4e87f46dad2-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:24:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Flow 'volume_create_manager' (8367a19c-5499-41f5-80f5-16624534b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f62be6-1578-4fe3-8cc3-de0a54bf1719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f62be6-1578-4fe3-8cc3-de0a54bf1719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0736d577-8637-4ea1-843b-e7dc21f780a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849fcd61602646a9ae21bb2cc3afaa1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:29Z,use_quota=True,user_id='bd0fd6720ffc4700a268461d76e2acb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed1afcbe-53bf-4a4b-99af-6aa9e18e1f47),volume_type_id=ed1afcbe-53bf-4a4b-99af-6aa9e18e1f47)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fda5bde-c5df-4778-ae86-b3b64000edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fda5bde-c5df-4778-ae86-b3b64000edca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34c8902-20c1-4f0c-a64b-32d8795d5d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:28 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:24:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e57ef035-74d0-4d40-99f1-dabcf8bd9f0d tempest-GroupsV320Test-473178967 None] Group tempest-GroupsV320Test-Group-1882233081: creating
Jun 24 04:24:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e57ef035-74d0-4d40-99f1-dabcf8bd9f0d tempest-GroupsV320Test-473178967 None] Group tempest-GroupsV320Test-Group-1882233081: created successfully
Jun 24 04:24:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e57ef035-74d0-4d40-99f1-dabcf8bd9f0d tempest-GroupsV320Test-473178967 None] Create group completed successfully.
Jun 24 04:24:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34c8902-20c1-4f0c-a64b-32d8795d5d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0736d577-8637-4ea1-843b-e7dc21f780a0', 'volume_name': 'volume-0736d577-8637-4ea1-843b-e7dc21f780a0', 'volume_size': 1, 'image_id': '20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cba5f847a2ab3c30951a9603d4514e1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '849fcd61602646a9ae21bb2cc3afaa1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ddd037df1a0923adbb74219bd75767bcceddc6d6ffe38c02990f7218350c3886c0ac895804e9cf406e42904bb4068edda2a2c4b46f5c3bc576c3fab48855d0b', 'id': '20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'created_at': datetime.datetime(2026, 6, 24, 2, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 24, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f0925910>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aff881-8d00-4c3b-9f24-1d32ce4168c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41aff881-8d00-4c3b-9f24-1d32ce4168c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e88b29-8061-4540-8935-d6e95ae08c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Volume 0736d577-8637-4ea1-843b-e7dc21f780a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0736d577-8637-4ea1-843b-e7dc21f780a0', 'volume_size': 1, 'image_id': '20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cba5f847a2ab3c30951a9603d4514e1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '849fcd61602646a9ae21bb2cc3afaa1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ddd037df1a0923adbb74219bd75767bcceddc6d6ffe38c02990f7218350c3886c0ac895804e9cf406e42904bb4068edda2a2c4b46f5c3bc576c3fab48855d0b', 'id': '20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'created_at': datetime.datetime(2026, 6, 24, 2, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 24, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f0925910>}
Jun 24 04:24:29 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Trying to clone 0736d577-8637-4ea1-843b-e7dc21f780a0 from image 20631dc9-039f-453a-b60d-bf8ef1bdfb78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:24:29 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:24:29 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Image download 0.00 MB at 0.00 MB/s
Jun 24 04:24:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[801dd5a4-19b2-427b-8434-ec9118f0ffa3]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:29 devstack sudo[105349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD
Jun 24 04:24:29 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:30 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:30 devstack sudo[105353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD
Jun 24 04:24:30 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Created reservations ['c56bc70c-b049-47a4-b43c-9ce1a32dec66'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:30 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:30 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:31 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD" returned: 1 in 0.949s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:24:31 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Temporary image 20631dc9-039f-453a-b60d-bf8ef1bdfb78 is fetched for user bd0fd6720ffc4700a268461d76e2acb5. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:24:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ad8483-a8bc-4e8b-9b10-6f784b93ef1c]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:31 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD
Jun 24 04:24:31 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:31 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.694s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:31 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-93665feb-23e8-48ed-9ada-b35a708deed7 tempest-GroupsV320Test-473178967 None] Delete group completed successfully.
Jun 24 04:24:32 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD" returned: 0 in 0.800s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:32 devstack sudo[105367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD
Jun 24 04:24:32 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:33 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD" returned: 1 in 0.987s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0736d577-8637-4ea1-843b-e7dc21f780a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='849fcd61602646a9ae21bb2cc3afaa1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:29Z,use_quota=True,user_id='bd0fd6720ffc4700a268461d76e2acb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed1afcbe-53bf-4a4b-99af-6aa9e18e1f47),volume_type_id=ed1afcbe-53bf-4a4b-99af-6aa9e18e1f47)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Creating volume 0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:24:33 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:24:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:33 devstack sudo[105374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 1073741824
Jun 24 04:24:33 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:34 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 1073741824" returned: 0 in 1.062s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:34 devstack sudo[105381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0
Jun 24 04:24:34 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:35 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0" returned: 0 in 0.890s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:35 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Attempting download of 20631dc9-039f-453a-b60d-bf8ef1bdfb78 ((None, [{'url': 'file:///opt/stack/data/glance/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'metadata': {}}])) to volume 0736d577-8637-4ea1-843b-e7dc21f780a0. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:24:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b47703b-337c-4f60-b3d4-c2224779ea02]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20631dc9-039f-453a-b60d-bf8ef1bdfb78_qde5aqf8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:35 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20631dc9-039f-453a-b60d-bf8ef1bdfb78_qde5aqf8
Jun 24 04:24:35 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:35 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_20631dc9-039f-453a-b60d-bf8ef1bdfb78_qde5aqf8" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20631dc9-039f-453a-b60d-bf8ef1bdfb78_qde5aqf8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:36 devstack sudo[105390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20631dc9-039f-453a-b60d-bf8ef1bdfb78_qde5aqf8
Jun 24 04:24:36 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:36 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20631dc9-039f-453a-b60d-bf8ef1bdfb78_qde5aqf8" returned: 1 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_20631dc9-039f-453a-b60d-bf8ef1bdfb78_qde5aqf8' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:24:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[38258ed2-57f0-4cbb-b7b8-ee0b1788b23e]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:37 devstack sudo[105397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD
Jun 24 04:24:37 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:37 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD" returned: 0 in 0.917s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:37 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD
Jun 24 04:24:37 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:38 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:24:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Flow 'volume_create_manager' (a95bb655-ec7f-427b-b6b2-42fa918a96ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9ad54a-a8c2-4801-b729-954027a72ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9ad54a-a8c2-4801-b729-954027a72ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1992851061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a0b488-2eed-4a92-a7cf-6942ac5a1b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7334b50f6aeb4ac39bbb13f4d64844fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:39Z,use_quota=True,user_id='9f3b5ed1933044e8b99b3fd694583bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5648a92d-e63f-417e-9bac-1d17eb5d7bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5648a92d-e63f-417e-9bac-1d17eb5d7bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abac1005-f46e-412f-ad24-4df649628167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abac1005-f46e-412f-ad24-4df649628167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a0b488-2eed-4a92-a7cf-6942ac5a1b96', 'volume_name': 'volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3e4343-9b6d-47ce-939b-2bf7ecb31d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3e4343-9b6d-47ce-939b-2bf7ecb31d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea58314b-762e-4c9a-93ca-b8ec0593e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96', 'volume_size': 1}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1992851061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a0b488-2eed-4a92-a7cf-6942ac5a1b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7334b50f6aeb4ac39bbb13f4d64844fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:39Z,use_quota=True,user_id='9f3b5ed1933044e8b99b3fd694583bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Creating volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:24:39 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:39 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD" returned: 1 in 1.279s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:39 devstack sudo[105447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 1073741824
Jun 24 04:24:39 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] 20631dc9-039f-453a-b60d-bf8ef1bdfb78 was raw, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:39 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0
Jun 24 04:24:39 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:39 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_20631dc9-039f-453a-b60d-bf8ef1bdfb78__fa42673devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:24:39 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Converted 0.00 MB image at 0.00 MB/s
Jun 24 04:24:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:40 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 1G
Jun 24 04:24:40 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:40 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 1073741824" returned: 0 in 1.006s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:40 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96
Jun 24 04:24:40 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:40 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 1G" returned: 0 in 0.964s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[600f6e8d-0add-44f1-ba37-dec4004f4f78]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:41 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" returned: 0 in 0.989s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:41 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0
Jun 24 04:24:41 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea58314b-762e-4c9a-93ca-b8ec0593e474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d9e794-1902-44f4-96bb-dc87aa261926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Volume volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 (f3a0b488-2eed-4a92-a7cf-6942ac5a1b96): created successfully
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d9e794-1902-44f4-96bb-dc87aa261926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Flow 'volume_create_manager' (a95bb655-ec7f-427b-b6b2-42fa918a96ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-507306a3-8de6-4921-967e-d10d996c52b2 tempest-SnapshotsActionsTest-28922092 None] Created volume successfully.
Jun 24 04:24:41 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:41 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0
Jun 24 04:24:41 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Creating offline snapshot 239443bf-4f83-41f7-8881-09510248dbbe of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e02db9-9d7c-458c-81cb-670bcc9f695c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:42 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96
Jun 24 04:24:42 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:42 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0" returned: 1 in 0.964s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Downloaded image 20631dc9-039f-453a-b60d-bf8ef1bdfb78 ((None, [{'url': 'file:///opt/stack/data/glance/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'metadata': {}}])) to volume 0736d577-8637-4ea1-843b-e7dc21f780a0 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Temporary image 20631dc9-039f-453a-b60d-bf8ef1bdfb78 for user bd0fd6720ffc4700a268461d76e2acb5 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Marking volume 0736d577-8637-4ea1-843b-e7dc21f780a0 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Copying metadata from image 20631dc9-039f-453a-b60d-bf8ef1bdfb78 to 0736d577-8637-4ea1-843b-e7dc21f780a0. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Creating volume glance metadata for volume 0736d577-8637-4ea1-843b-e7dc21f780a0 backed by image 20631dc9-039f-453a-b60d-bf8ef1bdfb78 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cba5f847a2ab3c30951a9603d4514e1f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e88b29-8061-4540-8935-d6e95ae08c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0736d577-8637-4ea1-843b-e7dc21f780a0', 'volume_size': 1, 'image_id': '20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cba5f847a2ab3c30951a9603d4514e1f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '849fcd61602646a9ae21bb2cc3afaa1a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ddd037df1a0923adbb74219bd75767bcceddc6d6ffe38c02990f7218350c3886c0ac895804e9cf406e42904bb4068edda2a2c4b46f5c3bc576c3fab48855d0b', 'id': '20631dc9-039f-453a-b60d-bf8ef1bdfb78', 'created_at': datetime.datetime(2026, 6, 24, 2, 24, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 24, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/20631dc9-039f-453a-b60d-bf8ef1bdfb78/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f0925910>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6557ddf5-168c-47e4-8b0f-383259781d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Volume volume-0736d577-8637-4ea1-843b-e7dc21f780a0 (0736d577-8637-4ea1-843b-e7dc21f780a0): created successfully
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6557ddf5-168c-47e4-8b0f-383259781d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Flow 'volume_create_manager' (8367a19c-5499-41f5-80f5-16624534b9da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-52c682c8-2c96-43f2-a3d1-fcbc9ebd31f0 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Created volume successfully.
Jun 24 04:24:43 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" returned: 0 in 0.801s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:43 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe 1G
Jun 24 04:24:43 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Acquiring lock "cinder-0736d577-8637-4ea1-843b-e7dc21f780a0-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "cinder-0736d577-8637-4ea1-843b-e7dc21f780a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Acquiring lock "cinder-quobyte-0736d577-8637-4ea1-843b-e7dc21f780a0" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "cinder-quobyte-0736d577-8637-4ea1-843b-e7dc21f780a0" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db00ec5-59dc-4d09-8791-2c147a3fe167]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:44 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe 1G" returned: 0 in 0.927s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:44 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:24:44 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:44 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0
Jun 24 04:24:44 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:45 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0" returned: 0 in 1.171s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:45 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 1.270s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:45 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe is being set with open permissions: ugo+rw
Jun 24 04:24:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:45 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0
Jun 24 04:24:45 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:45 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:24:45 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:46 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0" returned: 1 in 0.994s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:24:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:46 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 0.840s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:46 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0
Jun 24 04:24:46 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:46 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.info
Jun 24 04:24:46 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:47 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0736d577-8637-4ea1-843b-e7dc21f780a0" returned: 0 in 1.007s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "cinder-quobyte-0736d577-8637-4ea1-843b-e7dc21f780a0" released by "delete_volume" :: held 3.246s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:47 devstack cinder-volume[93468]: WARNING cinder.quota [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:47 devstack cinder-volume[93468]: WARNING cinder.quota [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:24:47 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.info" returned: 0 in 1.029s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:47 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.info is being set with open permissions: ugo+rw
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Created reservations ['c89a1d82-7099-40a5-a1fa-f4b7dd3f69e4', '130a619f-7b96-4093-bd26-487f1aba8969', '1cffdc41-5c17-49d4-9415-47891b3fa155', 'a959e93f-b9f9-440c-9c93-f0270067028e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:47 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.info
Jun 24 04:24:47 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:47 devstack sudo[105550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:24:47 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:48 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.info" returned: 0 in 0.787s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.790s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9bbbd5ff-2dce-435b-a787-10baaadd829f tempest-SnapshotsActionsTest-28922092 None] Create snapshot completed successfully
Jun 24 04:24:48 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.829s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:48 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:24:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Deleted volume successfully.
Jun 24 04:24:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-7d1a0945-2385-4b5a-8bc9-b788313b1b69 tempest-VolumeAndVolumeTypeFromImageTest-1973458737 None] Lock "cinder-0736d577-8637-4ea1-843b-e7dc21f780a0-delete_volume" released by "delete_volume" :: held 4.406s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Creating offline snapshot a076db38-e5a1-443e-b0a3-5c3d49e50b85 of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:24:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474bf89-3b28-4001-ab99-07486703707c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:50 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:24:50 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:51 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 1.304s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:24:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:51 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 1G
Jun 24 04:24:51 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:52 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 1G" returned: 0 in 1.058s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:52 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85
Jun 24 04:24:52 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:53 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:53 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 is being set with open permissions: ugo+rw
Jun 24 04:24:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:53 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85
Jun 24 04:24:53 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:53 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85" returned: 0 in 0.826s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.124s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1466e439-0cbe-4743-8e58-4659d54b70c7 tempest-SnapshotsActionsTest-28922092 None] Create snapshot completed successfully
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-a076db38-e5a1-443e-b0a3-5c3d49e50b85-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-a076db38-e5a1-443e-b0a3-5c3d49e50b85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-quobyte-a076db38-e5a1-443e-b0a3-5c3d49e50b85" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-a076db38-e5a1-443e-b0a3-5c3d49e50b85" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Deleting offline snapshot a076db38-e5a1-443e-b0a3-5c3d49e50b85 of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] snapshot_file for this snap is: volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4284eed-082f-4c88-ad4c-82931537d9cc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:55 devstack sudo[105578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85
Jun 24 04:24:55 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (2880a1b2-2814-4274-8bfd-a51621633a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae849e10-24da-4e67-94d1-f5283430a38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae849e10-24da-4e67-94d1-f5283430a38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-278111315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efac8135-bf0a-40bd-bf85-69cb78b53218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:56Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fe6f0e-0a3a-4edd-ab3a-55ed96e47107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fe6f0e-0a3a-4edd-ab3a-55ed96e47107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cf71c9-1cb9-4658-b7ac-1d58759e36d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cf71c9-1cb9-4658-b7ac-1d58759e36d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efac8135-bf0a-40bd-bf85-69cb78b53218', 'volume_name': 'volume-efac8135-bf0a-40bd-bf85-69cb78b53218', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee1ca7-2943-40bb-92fa-fa4aca0c034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee1ca7-2943-40bb-92fa-fa4aca0c034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a68610-b6ff-4304-9d0a-3f7f183f3353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume efac8135-bf0a-40bd-bf85-69cb78b53218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efac8135-bf0a-40bd-bf85-69cb78b53218', 'volume_size': 1}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-278111315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efac8135-bf0a-40bd-bf85-69cb78b53218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:24:56Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Creating volume efac8135-bf0a-40bd-bf85-69cb78b53218 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:24:55 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:24:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:55 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218 1073741824
Jun 24 04:24:55 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:56 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85" returned: 0 in 0.924s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:24:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1126a85-ae55-4328-85bf-3b69655af6e1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:56 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:24:56 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:56 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218 1073741824" returned: 0 in 1.010s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:56 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=76,cinder:UPDATE=71,cinder:INSERT=29,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:24:56 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=78,cinder:UPDATE=92,cinder:INSERT=19,cinder:DELETE=6 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:24:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:56 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218
Jun 24 04:24:56 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:57 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 1.050s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:57 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85
Jun 24 04:24:57 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:57 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218" returned: 0 in 0.893s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a68610-b6ff-4304-9d0a-3f7f183f3353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efac8135-bf0a-40bd-bf85-69cb78b53218', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d77948e-aeda-44c4-b31e-92cd2143f5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:24:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume volume-efac8135-bf0a-40bd-bf85-69cb78b53218 (efac8135-bf0a-40bd-bf85-69cb78b53218): created successfully
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d77948e-aeda-44c4-b31e-92cd2143f5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:24:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (2880a1b2-2814-4274-8bfd-a51621633a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:24:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-63fa05e4-9c49-4bfe-b472-77826f68e64b tempest-CreateVolumesFromSnapshotTest-154405347 None] Created volume successfully.
Jun 24 04:24:58 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85" returned: 0 in 1.088s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:58 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85
Jun 24 04:24:58 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Creating offline snapshot 17067cf9-ff63-4973-b94d-abdb139633b7 of volume efac8135-bf0a-40bd-bf85-69cb78b53218 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9339ef28-499e-42d3-aa2e-2edc6d957fa1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:24:59 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.a076db38-e5a1-443e-b0a3-5c3d49e50b85" returned: 0 in 0.893s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-a076db38-e5a1-443e-b0a3-5c3d49e50b85" released by "_delete_snapshot" :: held 4.116s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" released by "delete_snapshot" :: held 4.167s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:24:59 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218
Jun 24 04:24:59 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Created reservations ['3b2093b8-20f4-4158-a163-5332de1ec1f0', '00c5b2d1-e53d-466e-8b93-5b8d7cb8aef8', 'e4d05514-051c-45f9-84fc-98b373b8aee9', '03af3352-77db-4bdd-8a09-9e4cd15963af'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:24:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Delete snapshot completed successfully.
Jun 24 04:24:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ac04e064-3761-44ec-b625-13f39b783169 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-a076db38-e5a1-443e-b0a3-5c3d49e50b85-delete_snapshot" released by "delete_snapshot" :: held 4.384s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:00 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218" returned: 0 in 1.004s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:00 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 1G
Jun 24 04:25:00 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:01 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 1G" returned: 0 in 1.448s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efac8135-bf0a-40bd-bf85-69cb78b53218 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:01 devstack sudo[105955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efac8135-bf0a-40bd-bf85-69cb78b53218 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7
Jun 24 04:25:01 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:01 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:01 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:02 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.912s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:25:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:25:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:25:02 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efac8135-bf0a-40bd-bf85-69cb78b53218 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7" returned: 0 in 1.039s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:02 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 is being set with open permissions: ugo+rw
Jun 24 04:25:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:02 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7
Jun 24 04:25:02 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:03 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7" returned: 0 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:03 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.info
Jun 24 04:25:03 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:04 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.info" returned: 0 in 0.711s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:04 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.info is being set with open permissions: ugo+rw
Jun 24 04:25:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:04 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.info
Jun 24 04:25:04 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:05 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.info" returned: 0 in 0.701s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.867s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Creating offline snapshot 901a36d9-fadb-455f-8bd4-83f4e6bfb339 of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:25:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-211aef5e-d175-4949-bfa7-afda5bed0835 tempest-CreateVolumesFromSnapshotTest-154405347 None] Create snapshot completed successfully
Jun 24 04:25:05 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a479391e-94c2-4377-83e6-b0610f726a19]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:05 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:05 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:06 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 0.928s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:06 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 1G
Jun 24 04:25:06 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (16f38848-fe75-403e-ab7c-ccf62d36ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1940c8-689b-4d4c-9d20-63cadcef381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1940c8-689b-4d4c-9d20-63cadcef381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1244046486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581f2455-a92b-43ce-ad29-26f81418b3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:06Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d348b9c1-de8f-4f69-8c44-e0908b610a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d348b9c1-de8f-4f69-8c44-e0908b610a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a09a9e2-cc73-41a1-8096-ccfd26421838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a09a9e2-cc73-41a1-8096-ccfd26421838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '581f2455-a92b-43ce-ad29-26f81418b3df', 'volume_name': 'volume-581f2455-a92b-43ce-ad29-26f81418b3df', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db730ee-16b2-49a1-be8d-3a78389cea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db730ee-16b2-49a1-be8d-3a78389cea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792274d5-2151-40af-bb7d-05ba9ffcf272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume 581f2455-a92b-43ce-ad29-26f81418b3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-581f2455-a92b-43ce-ad29-26f81418b3df', 'volume_size': 1}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (b22a0288-c62d-4ba8-8191-130b9f5f5dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf06506a-b60f-45ff-ae5c-aaa10dadcfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf06506a-b60f-45ff-ae5c-aaa10dadcfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1430093266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a74d0d-7ce3-41e6-b2bd-5ba44a312886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:07Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c018581-146a-451f-b88b-769f338f221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c018581-146a-451f-b88b-769f338f221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7008010c-1ab4-4207-9e9c-4b03038bc183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7008010c-1ab4-4207-9e9c-4b03038bc183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a74d0d-7ce3-41e6-b2bd-5ba44a312886', 'volume_name': 'volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fcc79e-0434-4b72-9be6-b0d49eed0221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fcc79e-0434-4b72-9be6-b0d49eed0221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342f8e8b-1cfb-4ac4-be62-56afa3fce021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume 47a74d0d-7ce3-41e6-b2bd-5ba44a312886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886', 'volume_size': 1}
Jun 24 04:25:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (1492c506-a807-44ed-a8f3-acf18a4c00e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88834672-81f0-428c-8be7-9e3c9946afa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88834672-81f0-428c-8be7-9e3c9946afa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873776966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c085fe-e643-4899-819e-a9487802ab1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:07Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2734968-cdd8-4574-b790-391ecf39f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2734968-cdd8-4574-b790-391ecf39f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f998a019-68ea-47c9-81b1-a7b66368a8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f998a019-68ea-47c9-81b1-a7b66368a8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c085fe-e643-4899-819e-a9487802ab1e', 'volume_name': 'volume-41c085fe-e643-4899-819e-a9487802ab1e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d263e222-4a5b-47b1-b3f7-95fbea6f7bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d263e222-4a5b-47b1-b3f7-95fbea6f7bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a1fe7b-14b8-492d-8903-40e123830231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume 41c085fe-e643-4899-819e-a9487802ab1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c085fe-e643-4899-819e-a9487802ab1e', 'volume_size': 1}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:07 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 1G" returned: 0 in 1.318s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:07 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339
Jun 24 04:25:07 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (d7364e3e-bf9d-47ae-8eed-3e4cf18b2008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9771f63-e58c-4af4-b4b8-94da41475d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9771f63-e58c-4af4-b4b8-94da41475d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1952505983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:08Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f999d976-c8e6-416d-940e-c0ff2f7a041b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f999d976-c8e6-416d-940e-c0ff2f7a041b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b727e7-60a0-4e6f-98be-cd76f059fc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b727e7-60a0-4e6f-98be-cd76f059fc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02', 'volume_name': 'volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0191df2a-a92a-4b68-a185-f41d99bec545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0191df2a-a92a-4b68-a185-f41d99bec545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2957d-e942-43d9-a494-e28700ded277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02', 'volume_size': 1}
Jun 24 04:25:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (f7d3f096-7805-4d35-a787-566b91f11a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1d2e27-8c3d-4381-8499-96dd7a574441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1d2e27-8c3d-4381-8499-96dd7a574441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587779083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25026e8d-efa1-443f-94f8-664ba1b8b598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:08Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d6b28b-75f1-484c-9b74-f5bd1a384dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d6b28b-75f1-484c-9b74-f5bd1a384dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770bb1d8-00b0-4d24-8235-846165fe4602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770bb1d8-00b0-4d24-8235-846165fe4602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25026e8d-efa1-443f-94f8-664ba1b8b598', 'volume_name': 'volume-25026e8d-efa1-443f-94f8-664ba1b8b598', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6f3a37-48d6-40a9-982d-a0dd7089473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6f3a37-48d6-40a9-982d-a0dd7089473f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc61df99-0bb8-49d3-a66c-ab258618e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume 25026e8d-efa1-443f-94f8-664ba1b8b598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25026e8d-efa1-443f-94f8-664ba1b8b598', 'volume_size': 1}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:08 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Flow 'volume_create_manager' (ec77b02c-95b1-41bd-97cf-1de00c9e430c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17c856e-d990-4530-b32d-91abb9161d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339" returned: 0 in 0.888s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:08 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 is being set with open permissions: ugo+rw
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17c856e-d990-4530-b32d-91abb9161d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1143726005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9940df70-2037-4263-b692-be6889dcff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347f29042a024662822e66347a1b4e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:08Z,use_quota=True,user_id='8d22b0d2a79e459aba599daa78f42958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:08 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339
Jun 24 04:25:08 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57d628-9222-4243-af25-7aeaf200bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57d628-9222-4243-af25-7aeaf200bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d151da-968b-4385-b327-bd3208d22e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d151da-968b-4385-b327-bd3208d22e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9940df70-2037-4263-b692-be6889dcff66', 'volume_name': 'volume-9940df70-2037-4263-b692-be6889dcff66', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f07eb9b0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b474b-53a6-4a6b-9f76-f3491aa4ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b474b-53a6-4a6b-9f76-f3491aa4ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5745b76-3788-4bd9-a982-a9590b5fccca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Volume 9940df70-2037-4263-b692-be6889dcff66: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9940df70-2037-4263-b692-be6889dcff66', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f07eb9b0>}
Jun 24 04:25:08 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Trying to clone 9940df70-2037-4263-b692-be6889dcff66 from image d16527e6-13ec-4d21-b5b6-0410252234f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:25:09 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339" returned: 0 in 1.001s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.335s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:25:09 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Image download 20.69 MB at 20.69 MB/s
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.131s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1244046486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581f2455-a92b-43ce-ad29-26f81418b3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:06Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Creating volume 581f2455-a92b-43ce-ad29-26f81418b3df {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:09 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:09 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df 1073741824
Jun 24 04:25:09 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e887eb-fdf8-482c-90ad-00b5a3059283]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1ec0be4e-a188-4b17-b2b9-dfca4a1919c5 tempest-SnapshotsActionsTest-28922092 None] Create snapshot completed successfully
Jun 24 04:25:09 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD
Jun 24 04:25:09 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-901a36d9-fadb-455f-8bd4-83f4e6bfb339-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-901a36d9-fadb-455f-8bd4-83f4e6bfb339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-quobyte-901a36d9-fadb-455f-8bd4-83f4e6bfb339" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-901a36d9-fadb-455f-8bd4-83f4e6bfb339" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Deleting offline snapshot 901a36d9-fadb-455f-8bd4-83f4e6bfb339 of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] snapshot_file for this snap is: volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c17e3c5-88d7-4074-a795-858485f6b943]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:10 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339
Jun 24 04:25:10 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:10 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD" returned: 0 in 1.223s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Temporary image d16527e6-13ec-4d21-b5b6-0410252234f4 is fetched for user 8d22b0d2a79e459aba599daa78f42958. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b584df6-d768-4e93-843c-178c266328a0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:11 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD
Jun 24 04:25:11 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:11 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df 1073741824" returned: 0 in 1.529s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:11 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df
Jun 24 04:25:11 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:11 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339" returned: 0 in 1.239s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d83a61-a219-448c-bd19-505455b194a0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:12 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df" returned: 0 in 1.032s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] <== create_volume: return (2624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.656s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.349s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1430093266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a74d0d-7ce3-41e6-b2bd-5ba44a312886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:07Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Creating volume 47a74d0d-7ce3-41e6-b2bd-5ba44a312886 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:12 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:12 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:12 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:12 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD" returned: 0 in 1.217s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:12 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886 1073741824
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792274d5-2151-40af-bb7d-05ba9ffcf272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-581f2455-a92b-43ce-ad29-26f81418b3df', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:12 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ba84aa-30a9-4876-95c3-1e25658c6483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:12 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume volume-581f2455-a92b-43ce-ad29-26f81418b3df (581f2455-a92b-43ce-ad29-26f81418b3df): created successfully
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ba84aa-30a9-4876-95c3-1e25658c6483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (16f38848-fe75-403e-ab7c-ccf62d36ad72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-af961fcb-fea6-4557-9a37-78e430957db2 tempest-CreateVolumesFromSnapshotTest-154405347 None] Created volume successfully.
Jun 24 04:25:13 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 0.968s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:13 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339
Jun 24 04:25:13 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:13 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886 1073741824" returned: 0 in 1.121s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:13 devstack sudo[106136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886
Jun 24 04:25:13 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:14 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339" returned: 0 in 1.003s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:14 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339
Jun 24 04:25:14 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:14 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.808s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873776966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c085fe-e643-4899-819e-a9487802ab1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:07Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Creating volume 41c085fe-e643-4899-819e-a9487802ab1e {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:14 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:14 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e 1073741824
Jun 24 04:25:14 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342f8e8b-1cfb-4ac4-be62-56afa3fce021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9b4803-40b7-4734-bd84-0f0ef7c06fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886 (47a74d0d-7ce3-41e6-b2bd-5ba44a312886): created successfully
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9b4803-40b7-4734-bd84-0f0ef7c06fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (b22a0288-c62d-4ba8-8191-130b9f5f5dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d5af7416-57c8-4576-b2d3-c6f1a612b2d5 tempest-CreateVolumesFromSnapshotTest-154405347 None] Created volume successfully.
Jun 24 04:25:15 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.901a36d9-fadb-455f-8bd4-83f4e6bfb339" returned: 0 in 1.035s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-901a36d9-fadb-455f-8bd4-83f4e6bfb339" released by "_delete_snapshot" :: held 4.396s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" released by "delete_snapshot" :: held 4.421s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Created reservations ['d335ff97-c671-4f9e-9ac2-92d90e057c06', '0d3f61dd-2db4-47ea-8353-3ad3799d40a7', '36d2e00f-1e72-4e7a-b453-3730ae4dda3a', '57fdaab9-5918-49a8-97be-91d291b32693'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Delete snapshot completed successfully.
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0612ba20-4467-4443-aadb-2d41c8a8c0de tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-901a36d9-fadb-455f-8bd4-83f4e6bfb339-delete_snapshot" released by "delete_snapshot" :: held 4.586s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:15 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e 1073741824" returned: 0 in 1.100s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:15 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e
Jun 24 04:25:15 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:15 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e" returned: 0 in 0.711s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.281s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1952505983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:08Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Creating volume f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:16 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:16 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02 1073741824
Jun 24 04:25:16 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a1fe7b-14b8-492d-8903-40e123830231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c085fe-e643-4899-819e-a9487802ab1e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eafb200-ca48-4610-8891-a661e140f943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume volume-41c085fe-e643-4899-819e-a9487802ab1e (41c085fe-e643-4899-819e-a9487802ab1e): created successfully
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eafb200-ca48-4610-8891-a661e140f943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (1492c506-a807-44ed-a8f3-acf18a4c00e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f2c70ff1-0fab-47c4-8a97-0fb2a9d5f8fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Created volume successfully.
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:16 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02 1073741824" returned: 0 in 0.890s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:16 devstack sudo[106162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02
Jun 24 04:25:16 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:17 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02" returned: 0 in 0.648s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.452s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587779083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25026e8d-efa1-443f-94f8-664ba1b8b598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2825d21afcaf42f585e00a612f256cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:08Z,use_quota=True,user_id='80af66d54738404f9f0edc0a14c88663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Creating volume 25026e8d-efa1-443f-94f8-664ba1b8b598 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:17 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2957d-e942-43d9-a494-e28700ded277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c975a6-b38e-4724-ba61-091d4b0e1e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:17 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598 1073741824
Jun 24 04:25:17 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:17 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02 (f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02): created successfully
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c975a6-b38e-4724-ba61-091d4b0e1e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (d7364e3e-bf9d-47ae-8eed-3e4cf18b2008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-955c9fb0-5f60-48d4-97a0-f2ec0f87964d tempest-CreateVolumesFromSnapshotTest-154405347 None] Created volume successfully.
Jun 24 04:25:18 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598 1073741824" returned: 0 in 0.887s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:18 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598
Jun 24 04:25:18 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:19 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598" returned: 0 in 0.691s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.047s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1143726005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9940df70-2037-4263-b692-be6889dcff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347f29042a024662822e66347a1b4e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:08Z,use_quota=True,user_id='8d22b0d2a79e459aba599daa78f42958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Creating volume 9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:19 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc61df99-0bb8-49d3-a66c-ab258618e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25026e8d-efa1-443f-94f8-664ba1b8b598', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c4f19d-f7df-4980-acb7-66f46678850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:19 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 1073741824
Jun 24 04:25:19 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:19 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Volume volume-25026e8d-efa1-443f-94f8-664ba1b8b598 (25026e8d-efa1-443f-94f8-664ba1b8b598): created successfully
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c4f19d-f7df-4980-acb7-66f46678850a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Flow 'volume_create_manager' (f7d3f096-7805-4d35-a787-566b91f11a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-42f03be7-9fd0-46b9-ae04-89ccf763ef67 tempest-CreateVolumesFromSnapshotTest-154405347 None] Created volume successfully.
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-25026e8d-efa1-443f-94f8-664ba1b8b598-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-25026e8d-efa1-443f-94f8-664ba1b8b598-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-quobyte-25026e8d-efa1-443f-94f8-664ba1b8b598" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-25026e8d-efa1-443f-94f8-664ba1b8b598" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4b1b63-3988-4e22-841f-7ca3a4159027]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:19 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598
Jun 24 04:25:19 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:20 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 1073741824" returned: 0 in 0.954s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:20 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:25:20 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:20 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598" returned: 0 in 0.888s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:20 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598
Jun 24 04:25:20 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:21 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 0 in 0.756s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.666s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Creating offline snapshot cdca5efd-8d2b-4ef2-8805-4de3646d30ba of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307387a-994c-4647-ba3b-892fe3282b06]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Attempting download of d16527e6-13ec-4d21-b5b6-0410252234f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}])) to volume 9940df70-2037-4263-b692-be6889dcff66. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d2601c-ffcd-4bd6-8a5a-f730ff81b325]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_9vyottn8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:21 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:21 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:21 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-25026e8d-efa1-443f-94f8-664ba1b8b598" returned: 0 in 0.753s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:21 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_9vyottn8
Jun 24 04:25:21 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-25026e8d-efa1-443f-94f8-664ba1b8b598" released by "delete_volume" :: held 1.707s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Created reservations ['f849a541-f3f2-46e0-a1dc-b67460cfe065', 'bcb53608-8f69-44e6-bcd1-4dbd646339a8', '86bbfb93-6313-4a5e-bfee-4fa928ef1fe9', 'ce18e3fc-b4a6-4c27-9f91-68f90271347c'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:21 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:21 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-quobyte-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc32bad-b3c8-43f0-be91-673bf174eb13]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:22 devstack sudo[106291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02
Jun 24 04:25:22 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:22 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 1.333s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:22 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:22 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba 1G
Jun 24 04:25:22 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.019s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Deleted volume successfully.
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1f95aa42-40a4-4a53-bf61-373ca8b96031 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-25026e8d-efa1-443f-94f8-664ba1b8b598-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:22 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_9vyottn8" returned: 0 in 1.430s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_9vyottn8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:22 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_9vyottn8
Jun 24 04:25:22 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:23 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02" returned: 0 in 1.167s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:23 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02
Jun 24 04:25:23 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:23 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_9vyottn8" returned: 1 in 0.966s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d16527e6-13ec-4d21-b5b6-0410252234f4_9vyottn8' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[51337aa1-c97d-4694-8339-4782d3d07206]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:23 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba 1G" returned: 0 in 1.176s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:23 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba
Jun 24 04:25:23 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:23 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD
Jun 24 04:25:23 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:23 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02" returned: 0 in 0.685s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02" released by "delete_volume" :: held 1.903s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Created reservations ['023c32f7-f016-4693-af69-efb197843548', 'eac40c7c-b737-4514-aa7e-a428dd81d35a', '19ff0948-7a78-4852-83a7-2d27259cd99a', '224220e2-8eee-452d-8f88-205e9822dc13'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:24 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:24 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-41c085fe-e643-4899-819e-a9487802ab1e-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-41c085fe-e643-4899-819e-a9487802ab1e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-quobyte-41c085fe-e643-4899-819e-a9487802ab1e" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-41c085fe-e643-4899-819e-a9487802ab1e" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[901f8ae4-7677-4b2d-98b6-f00432523fcc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:24 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba" returned: 0 in 0.828s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:24 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba is being set with open permissions: ugo+rw
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:24 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD" returned: 0 in 0.866s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] d16527e6-13ec-4d21-b5b6-0410252234f4 was qcow2, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:25:24 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e
Jun 24 04:25:24 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:24 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba
Jun 24 04:25:24 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:24 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:25:24 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:24 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.709s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Deleted volume successfully.
Jun 24 04:25:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4c3bcb24-f473-4830-bb5b-3525d75eece3 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-f4c62fb4-9d2d-4f16-b77c-b12b3dc6ed02-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:25 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba" returned: 0 in 0.729s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-55186c12-21c9-4c3f-9fa4-1ec2ff47c2fc tempest-SnapshotsActionsTest-28922092 None] Create snapshot completed successfully
Jun 24 04:25:25 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e" returned: 0 in 0.974s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:25 devstack sudo[106375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e
Jun 24 04:25:25 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-cdca5efd-8d2b-4ef2-8805-4de3646d30ba-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-cdca5efd-8d2b-4ef2-8805-4de3646d30ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-quobyte-cdca5efd-8d2b-4ef2-8805-4de3646d30ba" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-cdca5efd-8d2b-4ef2-8805-4de3646d30ba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Deleting offline snapshot cdca5efd-8d2b-4ef2-8805-4de3646d30ba of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] snapshot_file for this snap is: volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dca207c-4f8b-48a9-b349-a7b4aa63975a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:26 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba
Jun 24 04:25:26 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:26 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-41c085fe-e643-4899-819e-a9487802ab1e" returned: 0 in 0.876s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-41c085fe-e643-4899-819e-a9487802ab1e" released by "delete_volume" :: held 1.905s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Created reservations ['4a3d6cd8-5057-4827-8c7e-e8cd62d79a57', 'bd177061-1044-48d9-9a8c-ca04c8cd94a3', '9b7d4042-6923-4ed8-8699-5a1cf2b85432', '4a808c43-2843-4d6d-ab6c-e8c19bcbaf49'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:26 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:26 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-47a74d0d-7ce3-41e6-b2bd-5ba44a312886-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-47a74d0d-7ce3-41e6-b2bd-5ba44a312886-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-quobyte-47a74d0d-7ce3-41e6-b2bd-5ba44a312886" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-47a74d0d-7ce3-41e6-b2bd-5ba44a312886" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f220b583-b0a3-4a5d-a9b4-993b2866e7ea]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:26 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 0 in 2.173s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d16527e6-13ec-4d21-b5b6-0410252234f4_xx9c5fmjdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:25:26 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Converted 112.00 MB image at 51.48 MB/s
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:26 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 1G
Jun 24 04:25:26 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:26 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886
Jun 24 04:25:26 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:26 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf2d5ca-0fb0-49b9-91ce-42f4f2051e33]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:27 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:27 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:27 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Deleted volume successfully.
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-59b96d23-9280-4c0e-b617-192b8b1f7700 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-41c085fe-e643-4899-819e-a9487802ab1e-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:27 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 1G" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:27 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[665ee628-c8d0-4b4b-a148-a7ad5940047a]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886" returned: 0 in 0.857s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:27 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886
Jun 24 04:25:27 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:27 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:25:27 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:27 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 0.860s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:27 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba
Jun 24 04:25:27 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:28 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-47a74d0d-7ce3-41e6-b2bd-5ba44a312886" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-47a74d0d-7ce3-41e6-b2bd-5ba44a312886" released by "delete_volume" :: held 1.676s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:28 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Created reservations ['9e7944db-39ad-4e39-abd0-1a9d7d4036f7', 'c36a9f6a-68dc-49c4-84f0-a7809e22d236', '6f9e80b5-586c-44ad-82e1-cbcd21aa11d0', 'af9dbd2b-21e9-4a5f-aec4-c38d8aa902ad'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:28 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:25:28 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:28 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:28 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:28 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba" returned: 0 in 0.839s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:28 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba
Jun 24 04:25:28 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-581f2455-a92b-43ce-ad29-26f81418b3df-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-581f2455-a92b-43ce-ad29-26f81418b3df-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-quobyte-581f2455-a92b-43ce-ad29-26f81418b3df" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-581f2455-a92b-43ce-ad29-26f81418b3df" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f6495c-52fc-4851-9c18-f06e1774b220]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:29 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df
Jun 24 04:25:29 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:29 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 1 in 0.884s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Downloaded image d16527e6-13ec-4d21-b5b6-0410252234f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}])) to volume 9940df70-2037-4263-b692-be6889dcff66 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Temporary image d16527e6-13ec-4d21-b5b6-0410252234f4 for user 8d22b0d2a79e459aba599daa78f42958 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Marking volume 9940df70-2037-4263-b692-be6889dcff66 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:25:29 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.800s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Deleted volume successfully.
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Copying metadata from image d16527e6-13ec-4d21-b5b6-0410252234f4 to 9940df70-2037-4263-b692-be6889dcff66. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Creating volume glance metadata for volume 9940df70-2037-4263-b692-be6889dcff66 backed by image d16527e6-13ec-4d21-b5b6-0410252234f4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ef656f6-8912-47cc-94d8-5a39e316444d tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-47a74d0d-7ce3-41e6-b2bd-5ba44a312886-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5745b76-3788-4bd9-a982-a9590b5fccca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9940df70-2037-4263-b692-be6889dcff66', 'volume_size': 1, 'image_id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d16527e6-13ec-4d21-b5b6-0410252234f4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '89250afdce9a443387c7b55460e60bdf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd16527e6-13ec-4d21-b5b6-0410252234f4', 'created_at': datetime.datetime(2026, 6, 24, 2, 6, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 6, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d16527e6-13ec-4d21-b5b6-0410252234f4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f07eb9b0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd89df3-c1a2-4265-a91c-89a258af0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Volume volume-9940df70-2037-4263-b692-be6889dcff66 (9940df70-2037-4263-b692-be6889dcff66): created successfully
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd89df3-c1a2-4265-a91c-89a258af0910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Flow 'volume_create_manager' (ec77b02c-95b1-41bd-97cf-1de00c9e430c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2fa030b4-c921-4b25-a080-62bf95dd39a1 tempest-TestShelveInstance-1387224078 None] Created volume successfully.
Jun 24 04:25:29 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.cdca5efd-8d2b-4ef2-8805-4de3646d30ba" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-cdca5efd-8d2b-4ef2-8805-4de3646d30ba" released by "_delete_snapshot" :: held 3.452s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" released by "delete_snapshot" :: held 3.483s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Created reservations ['7dec566c-710e-4000-aea7-2b148dd417b3', '1d2b51dc-6cb6-4608-877c-e6a523b51368', '15d8be1c-992e-4235-81bd-4d6f8db21e3e', '02a9a1bd-2670-4f40-8565-bd1bf458443a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Delete snapshot completed successfully.
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1ca8a356-f6f4-4699-93bb-dab7a38b4ea2 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-cdca5efd-8d2b-4ef2-8805-4de3646d30ba-delete_snapshot" released by "delete_snapshot" :: held 3.614s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:29 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df" returned: 0 in 0.878s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:29 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df
Jun 24 04:25:29 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Creating offline snapshot f0fc10a7-f423-4eec-9519-8cd3ba6c9506 of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[40069736-e6d2-4c75-8bf0-4b8d116dc898]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:30 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-581f2455-a92b-43ce-ad29-26f81418b3df" returned: 0 in 0.891s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-581f2455-a92b-43ce-ad29-26f81418b3df" released by "delete_volume" :: held 1.828s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Created reservations ['97a1c499-ffa7-43f1-bce6-984dddc00967', '65b94ec9-567f-4126-b8a3-04bfef67c77f', 'd05097fc-0603-486d-9cfe-ac58be2975e0', 'eec02fb5-6603-4a8e-be7c-482401f67467'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:30 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:30 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:30 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:30 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-17067cf9-ff63-4973-b94d-abdb139633b7-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-17067cf9-ff63-4973-b94d-abdb139633b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-quobyte-efac8135-bf0a-40bd-bf85-69cb78b53218" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-efac8135-bf0a-40bd-bf85-69cb78b53218" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-quobyte-17067cf9-ff63-4973-b94d-abdb139633b7" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-17067cf9-ff63-4973-b94d-abdb139633b7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Deleting offline snapshot 17067cf9-ff63-4973-b94d-abdb139633b7 of volume efac8135-bf0a-40bd-bf85-69cb78b53218 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] snapshot_file for this snap is: volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[815ceae8-a21a-4c5f-b270-df0c4ce081d3]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:31 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7
Jun 24 04:25:31 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:31 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 1.188s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:31 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 1G
Jun 24 04:25:31 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:31 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.043s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:31 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Deleted volume successfully.
Jun 24 04:25:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3c1a4f95-282c-41d9-bd61-8478745a76fb tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-581f2455-a92b-43ce-ad29-26f81418b3df-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:32 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7" returned: 0 in 1.099s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efac8135-bf0a-40bd-bf85-69cb78b53218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[98381792-2681-4110-a898-ec2e8eb57684]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:32 devstack sudo[106454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218
Jun 24 04:25:32 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:32 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 1G" returned: 0 in 0.975s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:32 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506
Jun 24 04:25:32 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:33 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:33 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7
Jun 24 04:25:33 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:33 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506" returned: 0 in 0.727s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:33 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 is being set with open permissions: ugo+rw
Jun 24 04:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:33 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506
Jun 24 04:25:33 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:33 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7" returned: 0 in 0.774s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:33 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7
Jun 24 04:25:33 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:34 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506" returned: 0 in 0.692s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.735s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-162c0787-692a-47f8-9f90-ec2df6d4aad0 tempest-SnapshotsActionsTest-28922092 None] Create snapshot completed successfully
Jun 24 04:25:34 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218.17067cf9-ff63-4973-b94d-abdb139633b7" returned: 0 in 0.714s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-17067cf9-ff63-4973-b94d-abdb139633b7" released by "_delete_snapshot" :: held 3.496s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-efac8135-bf0a-40bd-bf85-69cb78b53218" released by "delete_snapshot" :: held 3.532s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Created reservations ['104705d8-79b1-47f0-8e52-bb226a2f34f4', 'a9445d54-8813-4f56-9393-0c7fd3f31243', 'd36a69b2-d242-4bb0-bf1e-1ad4c8d8df8f', 'a1231f16-4f66-4201-9ce1-0fa93b2ebeb8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Delete snapshot completed successfully.
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-52c3e3d6-c453-4ea0-9346-98e303e39a36 tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-17067cf9-ff63-4973-b94d-abdb139633b7-delete_snapshot" released by "delete_snapshot" :: held 3.693s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Flow 'volume_create_manager' (2c03cb75-b239-4027-81df-7b48fc8ecd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5563e17-41cb-4b7a-9ec7-f92e58c68d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-f0fc10a7-f423-4eec-9519-8cd3ba6c9506-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5563e17-41cb-4b7a-9ec7-f92e58c68d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2011929794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68698f78-fc9e-449e-9844-d93f13327932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d72b9ea2b64b04bd224300919c2866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:35Z,use_quota=True,user_id='a0dbd63b568548839e63e35a63c353f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8ebaab-3420-4bcd-aa01-18c285cccfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8ebaab-3420-4bcd-aa01-18c285cccfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2c906c-93dc-4b72-bdc7-4cabfde9e414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2c906c-93dc-4b72-bdc7-4cabfde9e414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68698f78-fc9e-449e-9844-d93f13327932', 'volume_name': 'volume-68698f78-fc9e-449e-9844-d93f13327932', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7acdb69-1e87-4e3e-9871-2332ca429419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7acdb69-1e87-4e3e-9871-2332ca429419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66747db4-c81f-4067-b8ad-39da8ca140cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Volume 68698f78-fc9e-449e-9844-d93f13327932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68698f78-fc9e-449e-9844-d93f13327932', 'volume_size': 1}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2011929794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68698f78-fc9e-449e-9844-d93f13327932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d72b9ea2b64b04bd224300919c2866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:35Z,use_quota=True,user_id='a0dbd63b568548839e63e35a63c353f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Creating volume 68698f78-fc9e-449e-9844-d93f13327932 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:35 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-f0fc10a7-f423-4eec-9519-8cd3ba6c9506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:35 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932 1073741824
Jun 24 04:25:35 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Acquiring lock "cinder-quobyte-f0fc10a7-f423-4eec-9519-8cd3ba6c9506" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f0fc10a7-f423-4eec-9519-8cd3ba6c9506" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Deleting offline snapshot f0fc10a7-f423-4eec-9519-8cd3ba6c9506 of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] snapshot_file for this snap is: volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9d264a-925a-4e24-a8e5-5aa3fe8275d1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:35 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506
Jun 24 04:25:35 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-efac8135-bf0a-40bd-bf85-69cb78b53218-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-efac8135-bf0a-40bd-bf85-69cb78b53218-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "cinder-quobyte-efac8135-bf0a-40bd-bf85-69cb78b53218" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-efac8135-bf0a-40bd-bf85-69cb78b53218" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[812d7590-2291-43fa-935c-28657463a0f7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:35 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218
Jun 24 04:25:35 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:35 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932 1073741824" returned: 0 in 0.881s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:35 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506" returned: 0 in 0.816s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:35 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932
Jun 24 04:25:35 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc31a4e-f3e6-4c61-a623-ad14e9f0c914]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:36 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:36 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:36 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218" returned: 0 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:36 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218
Jun 24 04:25:36 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:36 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932" returned: 0 in 0.802s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66747db4-c81f-4067-b8ad-39da8ca140cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68698f78-fc9e-449e-9844-d93f13327932', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fe34f8-dcdc-4c84-8a95-8424dbe9453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:36 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Volume volume-68698f78-fc9e-449e-9844-d93f13327932 (68698f78-fc9e-449e-9844-d93f13327932): created successfully
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fe34f8-dcdc-4c84-8a95-8424dbe9453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Flow 'volume_create_manager' (2c03cb75-b239-4027-81df-7b48fc8ecd36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-407986cc-6924-4823-801f-d77ac997b5e9 tempest-AttachVolumeTestJSON-474111615 None] Created volume successfully.
Jun 24 04:25:36 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 0.854s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:36 devstack sudo[106511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506
Jun 24 04:25:36 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:37 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-efac8135-bf0a-40bd-bf85-69cb78b53218" returned: 0 in 0.774s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-quobyte-efac8135-bf0a-40bd-bf85-69cb78b53218" released by "delete_volume" :: held 1.692s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Created reservations ['7155a8a7-41ee-4ca1-931f-105b54b146e1', '79da4024-1c97-4b4b-a471-24f353402d86', '3f777a0a-e12f-4ae4-bc3e-574006d286a2', 'efbf4404-fefe-45e1-b298-951369f247b0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:37 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:37 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:38 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506" returned: 0 in 1.265s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:38 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506
Jun 24 04:25:38 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:38 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.978s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Deleted volume successfully.
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d65e5ab1-d100-400d-ac1d-d3c01e06fd7f tempest-CreateVolumesFromSnapshotTest-154405347 None] Lock "cinder-efac8135-bf0a-40bd-bf85-69cb78b53218-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7e5ae3-4369-4023-81cb-a37fd9c3e1f2]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:38 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:25:38 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:38 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.f0fc10a7-f423-4eec-9519-8cd3ba6c9506" returned: 0 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f0fc10a7-f423-4eec-9519-8cd3ba6c9506" released by "_delete_snapshot" :: held 3.936s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" released by "delete_snapshot" :: held 3.961s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Created reservations ['0debcf38-028d-4b8d-8927-e1a9c771c135', '8d2317ea-f9d4-47ed-ae58-bd3278cb872b', '924ae8b9-66a3-4913-9dea-2c0bb1ae05cf', 'adba3c62-3cd4-4ea0-995d-8e575de9143f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Delete snapshot completed successfully.
Jun 24 04:25:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5b34c88d-6586-4aee-9b95-0d795951c130 tempest-SnapshotsActionsTest-575523038 None] Lock "cinder-f0fc10a7-f423-4eec-9519-8cd3ba6c9506-delete_snapshot" released by "delete_snapshot" :: held 4.202s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:39 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 0 in 1.201s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:39 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:25:39 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7c87b3b9-202d-4b59-9258-169ffca49d1e req-ddf782a8-af3c-44e0-8107-0dde91db892b tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:40 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 1 in 0.766s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:25:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7c87b3b9-202d-4b59-9258-169ffca49d1e req-ddf782a8-af3c-44e0-8107-0dde91db892b tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.357s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f60eb03-2125-451f-947c-e74acc29b663]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7c87b3b9-202d-4b59-9258-169ffca49d1e req-ddf782a8-af3c-44e0-8107-0dde91db892b tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-9940df70-2037-4263-b692-be6889dcff66', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9915c92-3886-488d-895c-4b324bd241e0', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:25:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-9afbda30-6bf3-425c-b00a-6b18d6a710ae req-2f2e6825-b997-493c-a1e8-3c2325e5d95d tempest-TestShelveInstance-1387224078 None] attachment_update completed successfully.
Jun 24 04:25:40 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932
Jun 24 04:25:40 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:41 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-7c87b3b9-202d-4b59-9258-169ffca49d1e req-ddf782a8-af3c-44e0-8107-0dde91db892b tempest-AttachVolumeTestJSON-474111615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932" returned: 0 in 0.778s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-7c87b3b9-202d-4b59-9258-169ffca49d1e req-ddf782a8-af3c-44e0-8107-0dde91db892b tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-7c87b3b9-202d-4b59-9258-169ffca49d1e req-ddf782a8-af3c-44e0-8107-0dde91db892b tempest-AttachVolumeTestJSON-474111615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-68698f78-fc9e-449e-9844-d93f13327932', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8c85328-1784-40ef-9794-74bfcd34632b', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:25:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-7c87b3b9-202d-4b59-9258-169ffca49d1e req-ddf782a8-af3c-44e0-8107-0dde91db892b tempest-AttachVolumeTestJSON-474111615 None] attachment_update completed successfully.
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "cinder-239443bf-4f83-41f7-8881-09510248dbbe-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-239443bf-4f83-41f7-8881-09510248dbbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "cinder-quobyte-239443bf-4f83-41f7-8881-09510248dbbe" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-quobyte-239443bf-4f83-41f7-8881-09510248dbbe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Deleting offline snapshot 239443bf-4f83-41f7-8881-09510248dbbe of volume f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] snapshot_file for this snap is: volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[07609fc3-69eb-4ab2-9dc0-84ef185dbc37]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:41 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:41 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:42 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 0.813s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:25:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e8409f-c1c2-4399-bf7f-b9fd9c507b3c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:42 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96
Jun 24 04:25:42 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:43 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" returned: 0 in 0.824s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:43 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:43 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:44 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 0.743s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:44 devstack sudo[106961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe
Jun 24 04:25:44 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:44 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96.239443bf-4f83-41f7-8881-09510248dbbe" returned: 0 in 0.626s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-quobyte-239443bf-4f83-41f7-8881-09510248dbbe" released by "_delete_snapshot" :: held 3.127s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" released by "delete_snapshot" :: held 3.153s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:44 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Created reservations ['d95a28af-80b8-44cd-b46c-98631c7d7b88', '186b0346-b0b7-4399-9011-8a26a2a06491', '1ac8a454-debc-4060-80d0-3fc1f658438b', '6ebe2fdb-9cdf-4460-a109-699360887b25'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Delete snapshot completed successfully.
Jun 24 04:25:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-eeef1976-c1f5-4446-9b9c-3a034d153643 tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-239443bf-4f83-41f7-8881-09510248dbbe-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "cinder-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[006082e0-e83c-40f0-9f72-a555332e18a8]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:46 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96
Jun 24 04:25:46 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:47 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" returned: 0 in 1.494s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:47 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96
Jun 24 04:25:47 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Flow 'volume_create_manager' (b3e2ad8d-99cf-445e-80c5-5c753354bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc1e5b9-072d-4f03-ac47-693569822318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc1e5b9-072d-4f03-ac47-693569822318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-560506606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3623e8b5-11a7-452a-8a84-525733b0ce94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d72b9ea2b64b04bd224300919c2866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:48Z,use_quota=True,user_id='a0dbd63b568548839e63e35a63c353f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7653d0-d335-4863-a1c2-c098e6bf6b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7653d0-d335-4863-a1c2-c098e6bf6b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d88746b-44a9-48e7-9291-06f3ef80406e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d88746b-44a9-48e7-9291-06f3ef80406e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3623e8b5-11a7-452a-8a84-525733b0ce94', 'volume_name': 'volume-3623e8b5-11a7-452a-8a84-525733b0ce94', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8f23fd-094a-4bb8-a7c0-fdec5035870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8f23fd-094a-4bb8-a7c0-fdec5035870b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed207c3-df92-4671-a30c-da6f60b9a69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Volume 3623e8b5-11a7-452a-8a84-525733b0ce94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3623e8b5-11a7-452a-8a84-525733b0ce94', 'volume_size': 1}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-560506606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3623e8b5-11a7-452a-8a84-525733b0ce94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d72b9ea2b64b04bd224300919c2866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:48Z,use_quota=True,user_id='a0dbd63b568548839e63e35a63c353f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Creating volume 3623e8b5-11a7-452a-8a84-525733b0ce94 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:47 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:48 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94 1073741824
Jun 24 04:25:48 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:48 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" returned: 0 in 0.803s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-quobyte-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96" released by "delete_volume" :: held 2.368s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Created reservations ['4c920b48-8ba6-4e2e-b246-1ae4eda14889', 'eb366e9b-89cc-45b2-a83c-24b81f0e4348', '7b757ee9-f6d4-4ec6-9753-48cfe57aa0ec', 'fc53f3cd-13f0-4478-bdc3-70d4b7561849'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:48 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:48 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:49 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.908s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:49 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:25:49 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94 1073741824" returned: 0 in 1.288s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Deleted volume successfully.
Jun 24 04:25:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-455b6432-790f-483b-b634-95636119a8ff tempest-SnapshotsActionsTest-28922092 None] Lock "cinder-f3a0b488-2eed-4a92-a7cf-6942ac5a1b96-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:49 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94
Jun 24 04:25:49 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:50 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94" returned: 0 in 0.760s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed207c3-df92-4671-a30c-da6f60b9a69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3623e8b5-11a7-452a-8a84-525733b0ce94', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4441ca-8e9c-4c05-ad0e-0f5967ae763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:50 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Volume volume-3623e8b5-11a7-452a-8a84-525733b0ce94 (3623e8b5-11a7-452a-8a84-525733b0ce94): created successfully
Jun 24 04:25:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b4441ca-8e9c-4c05-ad0e-0f5967ae763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Flow 'volume_create_manager' (b3e2ad8d-99cf-445e-80c5-5c753354bba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3ca1bd34-3c5f-4a5d-94ec-f2ad42694348 tempest-AttachVolumeTestJSON-474111615 None] Created volume successfully.
Jun 24 04:25:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-8f9ccdbe-0cde-4238-adbf-4bc53a755752 req-3c284d69-420c-4fb6-8bad-d63a3f90085e tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-8f9ccdbe-0cde-4238-adbf-4bc53a755752 req-3c284d69-420c-4fb6-8bad-d63a3f90085e tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de1b178-26f4-4a77-ab69-ff0c4a13c025]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-8f9ccdbe-0cde-4238-adbf-4bc53a755752 req-3c284d69-420c-4fb6-8bad-d63a3f90085e tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:54 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94
Jun 24 04:25:54 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:55 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-8f9ccdbe-0cde-4238-adbf-4bc53a755752 req-3c284d69-420c-4fb6-8bad-d63a3f90085e tempest-AttachVolumeTestJSON-474111615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94" returned: 0 in 0.819s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-8f9ccdbe-0cde-4238-adbf-4bc53a755752 req-3c284d69-420c-4fb6-8bad-d63a3f90085e tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-8f9ccdbe-0cde-4238-adbf-4bc53a755752 req-3c284d69-420c-4fb6-8bad-d63a3f90085e tempest-AttachVolumeTestJSON-474111615 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-3623e8b5-11a7-452a-8a84-525733b0ce94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea5195a7-ed62-42d4-8eae-4bdeef466817', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:25:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-8f9ccdbe-0cde-4238-adbf-4bc53a755752 req-3c284d69-420c-4fb6-8bad-d63a3f90085e tempest-AttachVolumeTestJSON-474111615 None] attachment_update completed successfully.
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Flow 'volume_create_manager' (f4056b71-edaa-4608-a83a-c2bdf992311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c104fe-7b94-4b6f-8d25-c802d24e763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c104fe-7b94-4b6f-8d25-c802d24e763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1573368317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1210ecbe-2285-4a3a-acf6-be0e21a3778f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fcd546840ad403e8a89cbdc87ab002d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:56Z,use_quota=True,user_id='20881430c82546608277c2de4f868026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3714454-16df-4e0b-b5c5-33c693b055bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3714454-16df-4e0b-b5c5-33c693b055bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8d47b9-fc28-4857-884f-c41454f0eeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8d47b9-fc28-4857-884f-c41454f0eeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1210ecbe-2285-4a3a-acf6-be0e21a3778f', 'volume_name': 'volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f577fadb-0ce0-46ba-861b-c55d3ff8d11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f577fadb-0ce0-46ba-861b-c55d3ff8d11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07861953-8e42-4efe-8fd9-0e8640e6f3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Volume 1210ecbe-2285-4a3a-acf6-be0e21a3778f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f', 'volume_size': 1}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1573368317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1210ecbe-2285-4a3a-acf6-be0e21a3778f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fcd546840ad403e8a89cbdc87ab002d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:25:56Z,use_quota=True,user_id='20881430c82546608277c2de4f868026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Creating volume 1210ecbe-2285-4a3a-acf6-be0e21a3778f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:25:55 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:25:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:55 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f 1073741824
Jun 24 04:25:55 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:56 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f 1073741824" returned: 0 in 0.892s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:56 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f
Jun 24 04:25:56 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:57 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f" returned: 0 in 0.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=135,cinder:SELECT=111,cinder:INSERT=38,cinder:DELETE=9 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07861953-8e42-4efe-8fd9-0e8640e6f3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2179716a-118c-4f81-a58d-2f9004dd2722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=125,cinder:INSERT=38,cinder:UPDATE=122,cinder:DELETE=11 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:25:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Volume volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f (1210ecbe-2285-4a3a-acf6-be0e21a3778f): created successfully
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2179716a-118c-4f81-a58d-2f9004dd2722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:25:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Flow 'volume_create_manager' (f4056b71-edaa-4608-a83a-c2bdf992311e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:25:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d7abdec4-3d98-4439-801c-5e33768f533e tempest-VolumesServicesTestJSON-2011505791 None] Created volume successfully.
Jun 24 04:25:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Acquiring lock "cinder-1210ecbe-2285-4a3a-acf6-be0e21a3778f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Lock "cinder-1210ecbe-2285-4a3a-acf6-be0e21a3778f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Acquiring lock "cinder-quobyte-1210ecbe-2285-4a3a-acf6-be0e21a3778f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:25:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Lock "cinder-quobyte-1210ecbe-2285-4a3a-acf6-be0e21a3778f" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:25:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd4e40b-1ef0-4f16-bb5d-36464a1db1bc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:25:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:58 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f
Jun 24 04:25:58 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:59 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f" returned: 0 in 0.801s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:59 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f
Jun 24 04:25:59 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:25:59 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1210ecbe-2285-4a3a-acf6-be0e21a3778f" returned: 0 in 0.705s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Lock "cinder-quobyte-1210ecbe-2285-4a3a-acf6-be0e21a3778f" released by "delete_volume" :: held 1.544s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Created reservations ['5fea3325-87b2-4adb-95e3-ff151cb796a7', '420bdedd-0ba5-44be-a931-f06e8a036ed8', '8569d821-f47b-48f7-8848-b0505c00eb2f', '6e3aac6b-1538-4b49-b20b-92eaf7c65110'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:25:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:25:59 devstack sudo[107145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:25:59 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:00 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:00 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Deleted volume successfully.
Jun 24 04:26:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b7630d5c-c1c5-4b88-814b-b0849ff0ad40 tempest-VolumesServicesTestJSON-2011505791 None] Lock "cinder-1210ecbe-2285-4a3a-acf6-be0e21a3778f-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:01 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:26:01 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-aa71fe31-92a1-43de-85f8-7a845d741135 req-4698a52f-711a-41c1-a84c-9f403ab1d3a1 tempest-AttachVolumeTestJSON-474111615 None] Terminate volume connection completed successfully.
Jun 24 04:26:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-aa71fe31-92a1-43de-85f8-7a845d741135 req-4698a52f-711a-41c1-a84c-9f403ab1d3a1 tempest-AttachVolumeTestJSON-474111615 None] Deleting attachment a8c85328-1784-40ef-9794-74bfcd34632b. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:26:02 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.978s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:26:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:26:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:26:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-e297c34a-d0c9-42f0-8e0b-7cf4ad117a6d req-a1a7e62e-4420-4c1f-944d-6e6bde46363b tempest-AttachVolumeTestJSON-474111615 None] Terminate volume connection completed successfully.
Jun 24 04:26:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-e297c34a-d0c9-42f0-8e0b-7cf4ad117a6d req-a1a7e62e-4420-4c1f-944d-6e6bde46363b tempest-AttachVolumeTestJSON-474111615 None] Deleting attachment ea5195a7-ed62-42d4-8eae-4bdeef466817. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Flow 'volume_create_manager' (10ae6231-6e5a-4d9c-ba8f-e91c72808c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa9a14b-60fd-46de-bc58-2e2b7baf28be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa9a14b-60fd-46de-bc58-2e2b7baf28be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-933840012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c640d03b-b997-4657-b3ad-3965a1c276fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc8f20aa9bf450e93b1ddd4487a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:08Z,use_quota=True,user_id='d440b00060094fa09d3442115b415648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20178ce-822c-4ae6-b556-d63f9ccbc239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20178ce-822c-4ae6-b556-d63f9ccbc239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc88de5d-6948-465d-84cd-3ec8f1204e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc88de5d-6948-465d-84cd-3ec8f1204e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c640d03b-b997-4657-b3ad-3965a1c276fb', 'volume_name': 'volume-c640d03b-b997-4657-b3ad-3965a1c276fb', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f56a2e-7b12-471e-a732-534e0ae46b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f56a2e-7b12-471e-a732-534e0ae46b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d37083-2d06-4c88-9432-d599c2f124f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Volume c640d03b-b997-4657-b3ad-3965a1c276fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c640d03b-b997-4657-b3ad-3965a1c276fb', 'volume_size': 1}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-933840012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c640d03b-b997-4657-b3ad-3965a1c276fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc8f20aa9bf450e93b1ddd4487a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:08Z,use_quota=True,user_id='d440b00060094fa09d3442115b415648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Creating volume c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:26:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:07 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb 1073741824
Jun 24 04:26:07 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:08 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb 1073741824" returned: 0 in 0.969s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:08 devstack sudo[107281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb
Jun 24 04:26:08 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:09 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb" returned: 0 in 0.756s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d37083-2d06-4c88-9432-d599c2f124f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c640d03b-b997-4657-b3ad-3965a1c276fb', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f198d20e-795f-4651-9dd8-d0a3c26567de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Volume volume-c640d03b-b997-4657-b3ad-3965a1c276fb (c640d03b-b997-4657-b3ad-3965a1c276fb): created successfully
Jun 24 04:26:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f198d20e-795f-4651-9dd8-d0a3c26567de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Flow 'volume_create_manager' (10ae6231-6e5a-4d9c-ba8f-e91c72808c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-98f40898-3c2a-41bf-8dc6-2e56849bab19 tempest-VolumesCloneTest-853009490 None] Created volume successfully.
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Flow 'volume_create_manager' (71aa31cc-6133-4a99-b1fd-de58567dae14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e13d5c-07ae-446b-9d34-0a3807bd0c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e13d5c-07ae-446b-9d34-0a3807bd0c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-819507646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580b79ba-d21f-44e9-88d6-33a4cacbfc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc8f20aa9bf450e93b1ddd4487a4258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c640d03b-b997-4657-b3ad-3965a1c276fb,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:10Z,use_quota=True,user_id='d440b00060094fa09d3442115b415648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2ab966-c9e3-4f77-a096-a68e5519a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2ab966-c9e3-4f77-a096-a68e5519a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a943932-6c7d-4b8f-b71d-ddc2858618eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a943932-6c7d-4b8f-b71d-ddc2858618eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '580b79ba-d21f-44e9-88d6-33a4cacbfc23', 'volume_name': 'volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23', 'volume_size': 2, 'source_volid': 'c640d03b-b997-4657-b3ad-3965a1c276fb', 'source_volstatus': 'available'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a29080a-9033-4451-b1ad-00353027681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a29080a-9033-4451-b1ad-00353027681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9157ff32-2cee-450b-bffd-f47910ae3dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:10 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Volume 580b79ba-d21f-44e9-88d6-33a4cacbfc23: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23', 'volume_size': 2, 'source_volid': 'c640d03b-b997-4657-b3ad-3965a1c276fb', 'source_volstatus': 'available'}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:10 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Cloning volume c640d03b-b997-4657-b3ad-3965a1c276fb to volume 580b79ba-d21f-44e9-88d6-33a4cacbfc23
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Creating offline snapshot 922d18e1-50a7-4b6b-bc52-fd72e351f0b0 of volume c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[98124c16-0c29-4715-95a7-989ae0acbf5d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:10 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb
Jun 24 04:26:10 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:11 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb" returned: 0 in 0.910s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:11 devstack sudo[107335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 1G
Jun 24 04:26:11 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:12 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 1G" returned: 0 in 0.952s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c640d03b-b997-4657-b3ad-3965a1c276fb -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:12 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c640d03b-b997-4657-b3ad-3965a1c276fb -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0
Jun 24 04:26:12 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:13 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c640d03b-b997-4657-b3ad-3965a1c276fb -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0" returned: 0 in 0.713s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:13 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 is being set with open permissions: ugo+rw
Jun 24 04:26:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:13 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0
Jun 24 04:26:13 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:13 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:14 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.info
Jun 24 04:26:14 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:14 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.info" returned: 0 in 0.681s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:14 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.info is being set with open permissions: ugo+rw
Jun 24 04:26:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:14 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.info
Jun 24 04:26:14 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:15 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.info" returned: 0 in 0.681s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Acquiring lock "cinder-quobyte-580b79ba-d21f-44e9-88d6-33a4cacbfc23" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Lock "cinder-quobyte-580b79ba-d21f-44e9-88d6-33a4cacbfc23" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] snapshot: 922d18e1-50a7-4b6b-bc52-fd72e351f0b0, volume: 580b79ba-d21f-44e9-88d6-33a4cacbfc23,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7543ba4f-3a3c-4f2e-b971-8634baca20d4]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:15 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0
Jun 24 04:26:15 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:16 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0" returned: 0 in 0.905s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c640d03b-b997-4657-b3ad-3965a1c276fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b006a2d7-3bb7-4a56-aa82-31d684ab14e1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:16 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb
Jun 24 04:26:16 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "cinder-3623e8b5-11a7-452a-8a84-525733b0ce94-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-3623e8b5-11a7-452a-8a84-525733b0ce94-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "cinder-quobyte-3623e8b5-11a7-452a-8a84-525733b0ce94" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-quobyte-3623e8b5-11a7-452a-8a84-525733b0ce94" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0fb1b3-1965-4d08-b808-a1338f5e8828]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:17 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94
Jun 24 04:26:17 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:17 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb" returned: 0 in 0.822s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:17 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:26:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:17 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23
Jun 24 04:26:17 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:17 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:17 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94
Jun 24 04:26:17 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:19 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3623e8b5-11a7-452a-8a84-525733b0ce94" returned: 0 in 1.920s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-quobyte-3623e8b5-11a7-452a-8a84-525733b0ce94" released by "delete_volume" :: held 2.780s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:19 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Created reservations ['f7ceffce-7fb9-4b74-870d-0830d7f6f0c3', '1ac2f767-2fda-401f-b135-e4bdf3917b62', 'ed886ae6-4821-42a9-b847-4805e93ee197', '06514e8c-8590-48aa-a09c-e2894ecb3b9d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:20 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:26:20 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "cinder-68698f78-fc9e-449e-9844-d93f13327932-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-68698f78-fc9e-449e-9844-d93f13327932-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "cinder-quobyte-68698f78-fc9e-449e-9844-d93f13327932" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-quobyte-68698f78-fc9e-449e-9844-d93f13327932" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2cc3f5-67da-4c89-8e81-ea81e5da604e]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-d534d2ea-d73c-4c4d-b626-b9e9346f383e req-04ab9aa5-515c-4694-9b41-617aea386e08 tempest-TestShelveInstance-1387224078 None] Terminate volume connection completed successfully.
Jun 24 04:26:21 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-d534d2ea-d73c-4c4d-b626-b9e9346f383e req-04ab9aa5-515c-4694-9b41-617aea386e08 tempest-TestShelveInstance-1387224078 None] Deleting attachment a9915c92-3886-488d-895c-4b324bd241e0. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:26:21 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932
Jun 24 04:26:21 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:21 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.609s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Deleted volume successfully.
Jun 24 04:26:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53d3c32e-594e-443a-996f-3c0996e2c3be tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-3623e8b5-11a7-452a-8a84-525733b0ce94-delete_volume" released by "delete_volume" :: held 5.006s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:23 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932" returned: 0 in 2.353s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:23 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932
Jun 24 04:26:23 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:23 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23" returned: 0 in 6.203s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aa42a1-b9b3-468b-b279-0f75695daaf0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:23 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb
Jun 24 04:26:23 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:24 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-68698f78-fc9e-449e-9844-d93f13327932" returned: 0 in 0.829s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-quobyte-68698f78-fc9e-449e-9844-d93f13327932" released by "delete_volume" :: held 3.307s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Created reservations ['712f7f59-40ae-47b6-9c84-6b7dd2778955', '3a6d70d8-f337-4723-b6e5-23e628316021', 'a1817f69-3f95-4990-b60d-0ece2d654582', '001f413d-4f68-4d28-9a4c-779f993b4cc3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:24 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:26:24 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:24 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb" returned: 0 in 1.081s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:26:24 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Converted 1024.00 MB image at 165.05 MB/s
Jun 24 04:26:24 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23 is being set with open permissions: ugo+rw
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:24 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23
Jun 24 04:26:24 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:24 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.752s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:24 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Deleted volume successfully.
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-277af314-37ba-4110-a5ad-0574510517d6 tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-68698f78-fc9e-449e-9844-d93f13327932-delete_volume" released by "delete_volume" :: held 4.358s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "cinder-3d44fc44-f138-4693-ae54-c4fdb36eac52-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-3d44fc44-f138-4693-ae54-c4fdb36eac52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "cinder-quobyte-3d44fc44-f138-4693-ae54-c4fdb36eac52" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:25 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23" returned: 0 in 0.830s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Lock "cinder-quobyte-580b79ba-d21f-44e9-88d6-33a4cacbfc23" released by "_copy_volume_from_snapshot" :: held 9.988s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-quobyte-3d44fc44-f138-4693-ae54-c4fdb36eac52" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Acquiring lock "cinder-quobyte-922d18e1-50a7-4b6b-bc52-fd72e351f0b0" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b55e83-1b04-47e6-a64c-935be9afb975]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Lock "cinder-quobyte-922d18e1-50a7-4b6b-bc52-fd72e351f0b0" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Deleting offline snapshot 922d18e1-50a7-4b6b-bc52-fd72e351f0b0 of volume c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] snapshot_file for this snap is: volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c555a-c6a6-4901-aad3-30d1a4a6d08a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:25 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52
Jun 24 04:26:25 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:25 devstack sudo[107477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0
Jun 24 04:26:25 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:26 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52" returned: 0 in 0.821s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:26 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52
Jun 24 04:26:26 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:26 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0" returned: 0 in 0.847s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c640d03b-b997-4657-b3ad-3965a1c276fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:26:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c585b4-58df-49f0-a8a9-5c111501ceb4]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:26 devstack sudo[107488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb
Jun 24 04:26:26 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:27 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d44fc44-f138-4693-ae54-c4fdb36eac52" returned: 0 in 0.701s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-quobyte-3d44fc44-f138-4693-ae54-c4fdb36eac52" released by "delete_volume" :: held 1.574s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Created reservations ['12ccb82b-d5ad-4560-b53a-7e81b59d12b2', '6ba93f69-7ac8-4721-b70b-8896895d50b2', '0379f8bb-d3ec-4619-aaeb-615ec803d2ac', 'f969bfbc-5d3d-436a-9511-fc5d5d7091fb'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:27 devstack sudo[107495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:26:27 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:27 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb" returned: 0 in 0.855s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:27 devstack sudo[107497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0
Jun 24 04:26:27 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:27 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.761s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Deleted volume successfully.
Jun 24 04:26:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f33df0e2-ac54-48f3-b6a1-893b5d50bce0 tempest-AttachVolumeTestJSON-474111615 None] Lock "cinder-3d44fc44-f138-4693-ae54-c4fdb36eac52-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:28 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0" returned: 0 in 0.878s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:28 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0
Jun 24 04:26:28 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:28 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb.922d18e1-50a7-4b6b-bc52-fd72e351f0b0" returned: 0 in 0.704s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Lock "cinder-quobyte-922d18e1-50a7-4b6b-bc52-fd72e351f0b0" released by "_delete_snapshot" :: held 3.391s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.382s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.392s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9157ff32-2cee-450b-bffd-f47910ae3dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23', 'volume_size': 2, 'source_volid': 'c640d03b-b997-4657-b3ad-3965a1c276fb', 'source_volstatus': 'available'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4f464c-71a7-466e-8a0d-baa1fe32a6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Volume volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23 (580b79ba-d21f-44e9-88d6-33a4cacbfc23): created successfully
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4f464c-71a7-466e-8a0d-baa1fe32a6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Flow 'volume_create_manager' (71aa31cc-6133-4a99-b1fd-de58567dae14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6772c5f0-3422-4e4e-8ebc-ba8a9d12d92b]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9a26709f-9766-42e9-bba9-56bb7a104510 tempest-VolumesCloneTest-853009490 None] Created volume successfully.
Jun 24 04:26:29 devstack sudo[107514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:26:29 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Acquiring lock "cinder-580b79ba-d21f-44e9-88d6-33a4cacbfc23-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Lock "cinder-580b79ba-d21f-44e9-88d6-33a4cacbfc23-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Acquiring lock "cinder-quobyte-580b79ba-d21f-44e9-88d6-33a4cacbfc23" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Lock "cinder-quobyte-580b79ba-d21f-44e9-88d6-33a4cacbfc23" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63aee61-778a-43a7-bbf9-932fb2ad2e33]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:29 devstack sudo[107517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23
Jun 24 04:26:29 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:29 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 0 in 0.913s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:30 devstack sudo[107521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:26:30 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:30 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23" returned: 0 in 0.917s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:30 devstack sudo[107527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23
Jun 24 04:26:30 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:30 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 1 in 0.997s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:26:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.984s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-9940df70-2037-4263-b692-be6889dcff66', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e38e9687-ec72-40dd-9145-82dc5e452f1a', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:26:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-de508e3b-99eb-4321-9b5c-083492bbd348 req-b9aa3d0e-87ae-4c96-ae87-a3d2fa029349 tempest-TestShelveInstance-1387224078 None] attachment_update completed successfully.
Jun 24 04:26:31 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-580b79ba-d21f-44e9-88d6-33a4cacbfc23" returned: 0 in 0.868s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Lock "cinder-quobyte-580b79ba-d21f-44e9-88d6-33a4cacbfc23" released by "delete_volume" :: held 1.841s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Created reservations ['d977d2a8-ab8f-464e-ad42-6d441c861d9f', '4ef64cd5-7a5b-48f0-ab64-d064ef806328', 'bce96560-01c2-4686-811c-21788928154e', '737fadd6-376e-4943-9e6d-a71e5783ac1a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:31 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:26:31 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Acquiring lock "cinder-c640d03b-b997-4657-b3ad-3965a1c276fb-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Lock "cinder-c640d03b-b997-4657-b3ad-3965a1c276fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Acquiring lock "cinder-quobyte-c640d03b-b997-4657-b3ad-3965a1c276fb" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Lock "cinder-quobyte-c640d03b-b997-4657-b3ad-3965a1c276fb" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18ccf8a-ee22-4296-a799-61da5ac9b083]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:32 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb
Jun 24 04:26:32 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:32 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.879s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:32 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Deleted volume successfully.
Jun 24 04:26:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2f286b67-9556-449c-b441-6f45cbbac496 tempest-VolumesCloneTest-853009490 None] Lock "cinder-580b79ba-d21f-44e9-88d6-33a4cacbfc23-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:32 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb" returned: 0 in 0.887s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:32 devstack sudo[107544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb
Jun 24 04:26:32 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:33 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c640d03b-b997-4657-b3ad-3965a1c276fb" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Lock "cinder-quobyte-c640d03b-b997-4657-b3ad-3965a1c276fb" released by "delete_volume" :: held 1.635s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Created reservations ['e653fe2e-0df9-4037-8a20-49fbc21b758b', '2905fa09-ced1-41d4-87cc-d6e6fe7a79f0', 'f4c73c42-cfe2-4924-a423-1b37366a126c', 'cf501d4f-4d5f-40a1-a9ee-a7739fa503c9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:33 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:26:33 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:34 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.792s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:34 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Deleted volume successfully.
Jun 24 04:26:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6144c75c-bc69-40f4-aaf4-138cb1efb813 tempest-VolumesCloneTest-853009490 None] Lock "cinder-c640d03b-b997-4657-b3ad-3965a1c276fb-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Flow 'volume_create_manager' (f017caa9-cc9a-4f6f-9e0e-4a0318e36659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a4d924-815a-46b4-86f7-89f2671c286d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a4d924-815a-46b4-86f7-89f2671c286d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-140022502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660860d6-3c85-456c-af88-180750b9b7c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8810f18d30384068b0932ca7d6d71333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:36Z,use_quota=True,user_id='6000a33be5494aa489fc51059f0beff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fadab4-548c-4217-93ac-b47abc5729fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fadab4-548c-4217-93ac-b47abc5729fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3378424-0e05-46dd-9472-ea95cab80767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3378424-0e05-46dd-9472-ea95cab80767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660860d6-3c85-456c-af88-180750b9b7c7', 'volume_name': 'volume-660860d6-3c85-456c-af88-180750b9b7c7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e8ca36-638b-4760-9265-0b97cb19ab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e8ca36-638b-4760-9265-0b97cb19ab5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75b28a5-7102-460f-9ad8-09dbe2be5ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Volume 660860d6-3c85-456c-af88-180750b9b7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660860d6-3c85-456c-af88-180750b9b7c7', 'volume_size': 1}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-140022502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660860d6-3c85-456c-af88-180750b9b7c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8810f18d30384068b0932ca7d6d71333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:36Z,use_quota=True,user_id='6000a33be5494aa489fc51059f0beff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Creating volume 660860d6-3c85-456c-af88-180750b9b7c7 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:35 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:26:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:35 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7 1073741824
Jun 24 04:26:35 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:36 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7 1073741824" returned: 0 in 1.020s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:36 devstack sudo[107559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7
Jun 24 04:26:36 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Flow 'volume_create_manager' (dd30cbf2-5b6c-4f4b-b899-d27d9663145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7eb785-8aee-4383-9e51-b63cbcba23d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7eb785-8aee-4383-9e51-b63cbcba23d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1680194782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cfc674-b80f-43ad-a095-fa75be8d7d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e47cba08cc44c38949bbacd3e178df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:37Z,use_quota=True,user_id='4bdffac11128499e952ac6fc26f44f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90dc7f3-6d43-447f-9489-e05bb965d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c90dc7f3-6d43-447f-9489-e05bb965d099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1397e6-504d-4f1c-8fea-4ddac4fa4d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1397e6-504d-4f1c-8fea-4ddac4fa4d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82cfc674-b80f-43ad-a095-fa75be8d7d5e', 'volume_name': 'volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e', 'volume_size': 2}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b77267c-0f6d-4303-9df2-a11539dae26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b77267c-0f6d-4303-9df2-a11539dae26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b9c9da-023e-41a9-8a1e-b06953124191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Volume 82cfc674-b80f-43ad-a095-fa75be8d7d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e', 'volume_size': 2}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:37 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7" returned: 0 in 0.784s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1680194782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cfc674-b80f-43ad-a095-fa75be8d7d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e47cba08cc44c38949bbacd3e178df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:37Z,use_quota=True,user_id='4bdffac11128499e952ac6fc26f44f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Creating volume 82cfc674-b80f-43ad-a095-fa75be8d7d5e {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:37 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e 2147483648 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:37 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e 2147483648
Jun 24 04:26:37 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75b28a5-7102-460f-9ad8-09dbe2be5ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660860d6-3c85-456c-af88-180750b9b7c7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ae6653-fe66-423a-a096-4ce5d19f0958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Volume volume-660860d6-3c85-456c-af88-180750b9b7c7 (660860d6-3c85-456c-af88-180750b9b7c7): created successfully
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ae6653-fe66-423a-a096-4ce5d19f0958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Flow 'volume_create_manager' (f017caa9-cc9a-4f6f-9e0e-4a0318e36659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-4357f6cb-b5a2-4416-82ae-cff71089fb37 req-85c25cac-8ef2-4050-8414-c8300c4e8bd2 tempest-VolumesGetTestJSON-1094258835 None] Created volume successfully.
Jun 24 04:26:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Acquiring lock "cinder-660860d6-3c85-456c-af88-180750b9b7c7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Lock "cinder-660860d6-3c85-456c-af88-180750b9b7c7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Acquiring lock "cinder-quobyte-660860d6-3c85-456c-af88-180750b9b7c7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Lock "cinder-quobyte-660860d6-3c85-456c-af88-180750b9b7c7" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf533bac-bfcb-46b3-aa74-4cd90c8adeae]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:38 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7
Jun 24 04:26:38 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:38 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e 2147483648" returned: 0 in 1.075s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:38 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e
Jun 24 04:26:38 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:39 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7" returned: 0 in 0.884s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:39 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7
Jun 24 04:26:39 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:39 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e" returned: 0 in 0.754s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b9c9da-023e-41a9-8a1e-b06953124191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e', 'volume_size': 2}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e3ecb2-3496-4ecc-830f-ae09e74b7cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Volume volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e (82cfc674-b80f-43ad-a095-fa75be8d7d5e): created successfully
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e3ecb2-3496-4ecc-830f-ae09e74b7cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Flow 'volume_create_manager' (dd30cbf2-5b6c-4f4b-b899-d27d9663145f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-73920c69-93e1-4b2e-84e2-c85b36ae88f8 tempest-VolumesCloneNegativeTest-70556236 None] Created volume successfully.
Jun 24 04:26:40 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-660860d6-3c85-456c-af88-180750b9b7c7" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Lock "cinder-quobyte-660860d6-3c85-456c-af88-180750b9b7c7" released by "delete_volume" :: held 1.751s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG cinder.quota [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Created reservations ['5b0a6e13-660d-468a-9ab2-73575e66defa', '5fad169f-c430-4c70-863c-d640615a14ae', '547fadd5-1581-42ef-994f-2322a9caf893', '09dd633c-1a55-4635-8366-a3627e0c2e35'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:40 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:26:40 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Acquiring lock "cinder-82cfc674-b80f-43ad-a095-fa75be8d7d5e-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Lock "cinder-82cfc674-b80f-43ad-a095-fa75be8d7d5e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Acquiring lock "cinder-quobyte-82cfc674-b80f-43ad-a095-fa75be8d7d5e" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Lock "cinder-quobyte-82cfc674-b80f-43ad-a095-fa75be8d7d5e" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:41 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.717s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG cinder.manager [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Deleted volume successfully.
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd845cf-6294-4e6a-b08f-204b7f8d486e]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-33fe8745-6cbc-405f-bc4d-caca9f82dc72 req-21166c52-b8e5-4d0f-9e19-4e5f327e919b tempest-VolumesGetTestJSON-1094258835 None] Lock "cinder-660860d6-3c85-456c-af88-180750b9b7c7-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:41 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e
Jun 24 04:26:41 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:41 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e" returned: 0 in 0.904s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:42 devstack sudo[107658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e
Jun 24 04:26:42 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:42 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-82cfc674-b80f-43ad-a095-fa75be8d7d5e" returned: 0 in 0.742s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Lock "cinder-quobyte-82cfc674-b80f-43ad-a095-fa75be8d7d5e" released by "delete_volume" :: held 1.708s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Created reservations ['ecd0824f-0c0b-426f-865e-d7ae2ec7fc42', '41907f77-1dce-46cc-82e0-27dcd8c52712', '3f242c88-e558-4297-b65d-a83e0cb5bbd2', 'bacccacf-5d4a-4f37-a1a4-394a7178e158'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:42 devstack sudo[107990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:26:42 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:44 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.141s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:44 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:26:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Deleted volume successfully.
Jun 24 04:26:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6a3f160-fde2-45e5-a846-addec55fb043 tempest-VolumesCloneNegativeTest-70556236 None] Lock "cinder-82cfc674-b80f-43ad-a095-fa75be8d7d5e-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Flow 'volume_create_manager' (2d09f3d6-c853-4805-9065-e6f8cd71ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723566cc-40f2-4c16-a892-6714dace73e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723566cc-40f2-4c16-a892-6714dace73e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1102218063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ab5d16-03c0-4f63-b22d-96362e404c54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c18343ad9dcb425ebf1bc66414bde266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:48Z,use_quota=True,user_id='cbb84fb17b6f49b590b27448b0e8843b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077cbabf-68a6-4886-8340-1d8f6b93b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077cbabf-68a6-4886-8340-1d8f6b93b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3ffeea-3fdb-4b8a-9d60-f48108bf0d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd3ffeea-3fdb-4b8a-9d60-f48108bf0d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ab5d16-03c0-4f63-b22d-96362e404c54', 'volume_name': 'volume-36ab5d16-03c0-4f63-b22d-96362e404c54', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c371cb46-78c1-4c5b-b359-39627e60ed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c371cb46-78c1-4c5b-b359-39627e60ed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6385df-9138-4b70-9cd1-0bc390beb0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:48 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Volume 36ab5d16-03c0-4f63-b22d-96362e404c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ab5d16-03c0-4f63-b22d-96362e404c54', 'volume_size': 1}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1102218063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ab5d16-03c0-4f63-b22d-96362e404c54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c18343ad9dcb425ebf1bc66414bde266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:48Z,use_quota=True,user_id='cbb84fb17b6f49b590b27448b0e8843b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Creating volume 36ab5d16-03c0-4f63-b22d-96362e404c54 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:48 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:26:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:48 devstack sudo[108096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54 1073741824
Jun 24 04:26:48 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:49 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54 1073741824" returned: 0 in 1.025s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:49 devstack sudo[108101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54
Jun 24 04:26:49 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:50 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54" returned: 0 in 0.824s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6385df-9138-4b70-9cd1-0bc390beb0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ab5d16-03c0-4f63-b22d-96362e404c54', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b026a4-d076-4d02-8eb1-d35fa84fc354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:50 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Volume volume-36ab5d16-03c0-4f63-b22d-96362e404c54 (36ab5d16-03c0-4f63-b22d-96362e404c54): created successfully
Jun 24 04:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b026a4-d076-4d02-8eb1-d35fa84fc354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Flow 'volume_create_manager' (2d09f3d6-c853-4805-9065-e6f8cd71ab16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a2764c55-6ee0-4727-91ca-1789809133ce tempest-VolumesListTestJSON-1249623504 None] Created volume successfully.
Jun 24 04:26:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2a817a4b-90b1-423c-b396-f9662993701f tempest-GroupSnapshotsV319Test-1853385078 None] Group tempest-GroupSnapshotsV319Test-Group-1934897161: creating
Jun 24 04:26:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2a817a4b-90b1-423c-b396-f9662993701f tempest-GroupSnapshotsV319Test-1853385078 None] Group tempest-GroupSnapshotsV319Test-Group-1934897161: created successfully
Jun 24 04:26:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2a817a4b-90b1-423c-b396-f9662993701f tempest-GroupSnapshotsV319Test-1853385078 None] Create group completed successfully.
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Flow 'volume_create_manager' (d22aa4c4-4d17-4b85-9fc0-6c5c8d67a504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57c9094-a384-4a90-9cb4-f54e365d8b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f57c9094-a384-4a90-9cb4-f54e365d8b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1271412792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c18343ad9dcb425ebf1bc66414bde266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:52Z,use_quota=True,user_id='cbb84fb17b6f49b590b27448b0e8843b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704d26fc-57fe-434f-be0b-5621423a065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704d26fc-57fe-434f-be0b-5621423a065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdc4d93-1aeb-417e-9b89-effe5bca3cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdc4d93-1aeb-417e-9b89-effe5bca3cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f', 'volume_name': 'volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9d9bb2-9c5a-475a-a9c7-613b1015fb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9d9bb2-9c5a-475a-a9c7-613b1015fb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd5d890-dcbb-4182-b92d-972022de8c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Volume 3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f', 'volume_size': 1}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1271412792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c18343ad9dcb425ebf1bc66414bde266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:52Z,use_quota=True,user_id='cbb84fb17b6f49b590b27448b0e8843b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Creating volume 3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:51 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:26:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:52 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f 1073741824
Jun 24 04:26:52 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Flow 'volume_create_manager' (0b7bd5f9-2bbc-457c-962a-52c4190577b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e811a36-2de2-48bd-aa2b-3419202b310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e811a36-2de2-48bd-aa2b-3419202b310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391238152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6df290e8-4516-4c0b-bf7e-001d28f0f791,host='devstack@QuobyteHD#QuobyteHD',id=112c8742-0b77-4c7d-b14f-84e2308047e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a215c8cb3cf042a7ae42e285be100fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:52Z,use_quota=True,user_id='e7a6f07c37a64de68fa64d674048554c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41e3626a-e723-4d88-8b69-857532b299e7),volume_type_id=41e3626a-e723-4d88-8b69-857532b299e7)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97614562-a490-403a-ae8c-64dd1995c8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97614562-a490-403a-ae8c-64dd1995c8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3f4ff2-dcfd-4647-8ea6-6622f2c80100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3f4ff2-dcfd-4647-8ea6-6622f2c80100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '112c8742-0b77-4c7d-b14f-84e2308047e2', 'volume_name': 'volume-112c8742-0b77-4c7d-b14f-84e2308047e2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb0798-c74a-455b-b65a-8664f05056ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb0798-c74a-455b-b65a-8664f05056ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a71aee-b86e-443f-8965-5e0a265cfc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Volume 112c8742-0b77-4c7d-b14f-84e2308047e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-112c8742-0b77-4c7d-b14f-84e2308047e2', 'volume_size': 1}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:52 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f 1073741824" returned: 0 in 0.934s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:52 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f
Jun 24 04:26:52 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:53 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f" returned: 0 in 0.656s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6df290e8-4516-4c0b-bf7e-001d28f0f791,created_at=2026-06-24T02:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391238152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6df290e8-4516-4c0b-bf7e-001d28f0f791,host='devstack@QuobyteHD#QuobyteHD',id=112c8742-0b77-4c7d-b14f-84e2308047e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a215c8cb3cf042a7ae42e285be100fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:52Z,use_quota=True,user_id='e7a6f07c37a64de68fa64d674048554c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41e3626a-e723-4d88-8b69-857532b299e7),volume_type_id=41e3626a-e723-4d88-8b69-857532b299e7)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Creating volume 112c8742-0b77-4c7d-b14f-84e2308047e2 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:53 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:53 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2 1073741824
Jun 24 04:26:53 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd5d890-dcbb-4182-b92d-972022de8c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23481f0-5862-4b41-884e-4029204f051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Volume volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f (3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f): created successfully
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23481f0-5862-4b41-884e-4029204f051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Flow 'volume_create_manager' (d22aa4c4-4d17-4b85-9fc0-6c5c8d67a504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-01ae1b0b-b8ab-407d-8554-c45e5dbcfdfa tempest-VolumesListTestJSON-1249623504 None] Created volume successfully.
Jun 24 04:26:54 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Flow 'volume_create_manager' (2c3e7ad4-4f0a-4737-b664-dc9671eaa091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bef760e-71b7-45ad-baa9-607750345a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2 1073741824" returned: 0 in 0.969s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bef760e-71b7-45ad-baa9-607750345a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1541843119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d37f6eb-1b56-4f56-a91a-03ca884d5a67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c18343ad9dcb425ebf1bc66414bde266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:54Z,use_quota=True,user_id='cbb84fb17b6f49b590b27448b0e8843b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dc2757-22be-4b37-8433-238b18d179fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20dc2757-22be-4b37-8433-238b18d179fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952edd4a-e952-47df-98be-9c5d51432b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952edd4a-e952-47df-98be-9c5d51432b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d37f6eb-1b56-4f56-a91a-03ca884d5a67', 'volume_name': 'volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3b0308-5b70-43cf-89ff-bc6ac6061ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3b0308-5b70-43cf-89ff-bc6ac6061ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135251fd-f9d5-4efc-b302-2cdefb4e1a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:54 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Volume 1d37f6eb-1b56-4f56-a91a-03ca884d5a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67', 'volume_size': 1}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:54 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2
Jun 24 04:26:54 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:55 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2" returned: 0 in 0.657s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1541843119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d37f6eb-1b56-4f56-a91a-03ca884d5a67,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c18343ad9dcb425ebf1bc66414bde266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:26:54Z,use_quota=True,user_id='cbb84fb17b6f49b590b27448b0e8843b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Creating volume 1d37f6eb-1b56-4f56-a91a-03ca884d5a67 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:26:55 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a71aee-b86e-443f-8965-5e0a265cfc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-112c8742-0b77-4c7d-b14f-84e2308047e2', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61999fa-24aa-4ca4-b4b3-7303483f9ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:55 devstack sudo[108123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67 1073741824
Jun 24 04:26:55 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Volume volume-112c8742-0b77-4c7d-b14f-84e2308047e2 (112c8742-0b77-4c7d-b14f-84e2308047e2): created successfully
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61999fa-24aa-4ca4-b4b3-7303483f9ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Flow 'volume_create_manager' (0b7bd5f9-2bbc-457c-962a-52c4190577b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:55 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-23e6b63e-f784-4228-bcd6-d918aabd3b12 tempest-GroupSnapshotsV319Test-1853385078 None] Created volume successfully.
Jun 24 04:26:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] GroupSnapshot e055ceac-5bb6-4cd5-9116-6dd9498c3aba: creating.
Jun 24 04:26:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Group snapshot e055ceac-5bb6-4cd5-9116-6dd9498c3aba: creating. {{(pid=93468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jun 24 04:26:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:26:56 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67 1073741824" returned: 0 in 0.983s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:56 devstack sudo[108129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67
Jun 24 04:26:56 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:57 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67" returned: 0 in 0.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.733s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Creating offline snapshot 2056e05e-c763-42c6-89af-09b8bd96dd27 of volume 112c8742-0b77-4c7d-b14f-84e2308047e2 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135251fd-f9d5-4efc-b302-2cdefb4e1a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f339ef54-4d57-4166-b5c9-d78b560a124b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b05782-0c1f-4adc-9532-c531fc1a86f0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Volume volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67 (1d37f6eb-1b56-4f56-a91a-03ca884d5a67): created successfully
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f339ef54-4d57-4166-b5c9-d78b560a124b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Flow 'volume_create_manager' (2c3e7ad4-4f0a-4737-b664-dc9671eaa091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:26:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c45bca4e-8a24-4561-be36-34ef09fe9a4c tempest-VolumesListTestJSON-1249623504 None] Created volume successfully.
Jun 24 04:26:57 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2
Jun 24 04:26:57 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:57 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2" returned: 0 in 0.832s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:57 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 1G
Jun 24 04:26:57 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:58 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 1G" returned: 0 in 0.924s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112c8742-0b77-4c7d-b14f-84e2308047e2 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:58 devstack sudo[108143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112c8742-0b77-4c7d-b14f-84e2308047e2 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27
Jun 24 04:26:58 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:59 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112c8742-0b77-4c7d-b14f-84e2308047e2 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27" returned: 0 in 0.817s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:26:59 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:26:59 devstack sudo[108175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27
Jun 24 04:26:59 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "cinder-1d37f6eb-1b56-4f56-a91a-03ca884d5a67-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-1d37f6eb-1b56-4f56-a91a-03ca884d5a67-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=92,cinder:DELETE=9,cinder:SELECT=67,cinder:INSERT=23 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=76,cinder:INSERT=19,cinder:UPDATE=94,cinder:DELETE=8 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "cinder-quobyte-1d37f6eb-1b56-4f56-a91a-03ca884d5a67" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-quobyte-1d37f6eb-1b56-4f56-a91a-03ca884d5a67" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[880701b9-1451-4b98-ac7c-3f976049877f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:26:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:00 devstack sudo[108179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67
Jun 24 04:27:00 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:00 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27" returned: 0 in 0.748s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:00 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.info
Jun 24 04:27:00 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:00 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67" returned: 0 in 0.849s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:00 devstack sudo[108187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67
Jun 24 04:27:00 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:01 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.info" returned: 0 in 0.661s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:01 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.info is being set with open permissions: ugo+rw: NotImplementedError
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:01 devstack sudo[108190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.info
Jun 24 04:27:01 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:01 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1d37f6eb-1b56-4f56-a91a-03ca884d5a67" returned: 0 in 0.662s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-quobyte-1d37f6eb-1b56-4f56-a91a-03ca884d5a67" released by "delete_volume" :: held 1.561s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Created reservations ['28a22858-55ab-4e44-9666-03db4591d42d', '55ec0e8a-9974-4e3d-a450-639e661b74f5', 'a782440a-a66c-41f4-bab6-5cd3817b160f', '8453c56f-9e0e-472f-bec6-d4a8015735ff'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:01 devstack sudo[108194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:01 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:01 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.info" returned: 0 in 0.655s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:01 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:01 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e01a098c-1512-4e75-ab1b-a4dc5ff7ece3 tempest-GroupSnapshotsV319Test-1853385078 None] group_snapshot e055ceac-5bb6-4cd5-9116-6dd9498c3aba: created successfully
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "cinder-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "cinder-quobyte-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-quobyte-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f" acquired by "delete_volume" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca18a058-847c-4968-bc25-fc8c3cf30814]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:02 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.737s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Deleted volume successfully.
Jun 24 04:27:02 devstack sudo[108199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f
Jun 24 04:27:02 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-99c253b1-0774-49b0-9fc5-998d68c6986a tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-1d37f6eb-1b56-4f56-a91a-03ca884d5a67-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:02 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.718s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:27:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] group_snapshot e055ceac-5bb6-4cd5-9116-6dd9498c3aba: deleting
Jun 24 04:27:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] group_snapshot e055ceac-5bb6-4cd5-9116-6dd9498c3aba: deleting {{(pid=93468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Acquiring lock "cinder-quobyte-112c8742-0b77-4c7d-b14f-84e2308047e2" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "cinder-quobyte-112c8742-0b77-4c7d-b14f-84e2308047e2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Acquiring lock "cinder-quobyte-2056e05e-c763-42c6-89af-09b8bd96dd27" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "cinder-quobyte-2056e05e-c763-42c6-89af-09b8bd96dd27" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Deleting offline snapshot 2056e05e-c763-42c6-89af-09b8bd96dd27 of volume 112c8742-0b77-4c7d-b14f-84e2308047e2 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] snapshot_file for this snap is: volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e926e5-ec19-434a-94df-3820370b92e0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:03 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f" returned: 0 in 0.830s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:03 devstack sudo[108206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f
Jun 24 04:27:03 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:03 devstack sudo[108205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27
Jun 24 04:27:03 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:03 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f" returned: 0 in 0.648s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-quobyte-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f" released by "delete_volume" :: held 1.521s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Created reservations ['1ea8618c-0a15-445a-b5a4-6adf20b67260', '2440a188-e75a-4b75-824e-c731cd6890e1', '75a34af9-509d-4d49-ab8f-5db125cc9373', 'db4e0dd2-bad7-4dae-bd28-329e1df4d875'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:03 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27" returned: 0 in 0.826s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:03 devstack sudo[108213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112c8742-0b77-4c7d-b14f-84e2308047e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:27:03 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[619da8ec-a05d-4f75-9d2e-fca474b508a9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:04 devstack sudo[108215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2
Jun 24 04:27:04 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "cinder-36ab5d16-03c0-4f63-b22d-96362e404c54-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-36ab5d16-03c0-4f63-b22d-96362e404c54-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "cinder-quobyte-36ab5d16-03c0-4f63-b22d-96362e404c54" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-quobyte-36ab5d16-03c0-4f63-b22d-96362e404c54" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19c0460-cf63-4816-94c6-c97e48992cd5]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:04 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.724s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Deleted volume successfully.
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fa1ab400-ade2-421c-a523-0a3c94af67c2 tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-3e8f2f46-3f73-45ce-84f9-1fb7c3ea732f-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:04 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54
Jun 24 04:27:04 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:04 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2" returned: 0 in 0.801s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:04 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27
Jun 24 04:27:04 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:05 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54" returned: 0 in 0.794s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:05 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54
Jun 24 04:27:05 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:05 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27" returned: 0 in 0.741s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:05 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27
Jun 24 04:27:05 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:06 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-36ab5d16-03c0-4f63-b22d-96362e404c54" returned: 0 in 0.641s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-quobyte-36ab5d16-03c0-4f63-b22d-96362e404c54" released by "delete_volume" :: held 1.485s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Created reservations ['032e33af-81be-4957-a758-f4c3a04dedbe', '1912ce03-d64d-4b6c-ac0e-b34c0e2bb61c', '0da804cc-ebdd-4ca9-9b94-5939d15de754', '1f43f197-a223-41bc-bf72-c79069bba659'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:06 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2.2056e05e-c763-42c6-89af-09b8bd96dd27" returned: 0 in 0.667s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "cinder-quobyte-2056e05e-c763-42c6-89af-09b8bd96dd27" released by "_delete_snapshot" :: held 3.137s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Lock "cinder-quobyte-112c8742-0b77-4c7d-b14f-84e2308047e2" released by "delete_snapshot" :: held 3.167s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:06 devstack sudo[108238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:06 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:06 devstack cinder-volume[93468]: WARNING cinder.quota [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-56873590 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-56873590, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:27:06 devstack cinder-volume[93468]: WARNING cinder.quota [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-56873590 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-56873590, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:27:06 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] Created reservations ['414379c2-68f9-46df-8018-c0814f347b61', 'e6352f16-ca03-4b25-85aa-c915bda80433', 'da63e0bc-72b2-4a1a-9bbc-2c3b206c313b', 'd586688b-6d34-4752-b516-bccdd6ec509d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1a541690-f6e5-4f0e-aca4-6b8866218749 tempest-GroupSnapshotsV319Test-1853385078 None] group_snapshot e055ceac-5bb6-4cd5-9116-6dd9498c3aba: deleted successfully
Jun 24 04:27:07 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:07 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Deleted volume successfully.
Jun 24 04:27:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4b75e03-255e-4824-9539-a8b9abc61052 tempest-VolumesListTestJSON-1249623504 None] Lock "cinder-36ab5d16-03c0-4f63-b22d-96362e404c54-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Acquiring lock "cinder-quobyte-112c8742-0b77-4c7d-b14f-84e2308047e2" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Lock "cinder-quobyte-112c8742-0b77-4c7d-b14f-84e2308047e2" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda55e8d-59f6-4c1d-8252-1f884e638710]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:07 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2
Jun 24 04:27:07 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:08 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2" returned: 0 in 0.802s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:08 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2
Jun 24 04:27:08 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:09 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-112c8742-0b77-4c7d-b14f-84e2308047e2" returned: 0 in 0.654s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Lock "cinder-quobyte-112c8742-0b77-4c7d-b14f-84e2308047e2" released by "delete_volume" :: held 1.519s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Created reservations ['03a31f9e-c7a7-4ec0-b285-8a544a9f4ba7'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:09 devstack cinder-volume[93468]: WARNING cinder.quota [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-56873590 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-56873590, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Created reservations ['0f5c8946-b6ed-4c30-8e31-4c88871e07af', '928064ca-19b1-4360-96f4-ff0153ac4561', 'bfbe3036-7172-458f-8dd2-d3c66ff95611', '28d7348c-0d72-4897-a816-bfe4325ac01e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:09 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:09 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:10 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:10 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-72369f42-944f-413e-815a-e0e0567cf25d tempest-GroupSnapshotsV319Test-1853385078 None] Delete group completed successfully.
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (2e07ddf5-c1ba-4079-9f3a-99790ebd29a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628c39ca-0234-47f2-a683-71ef82d15401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (628c39ca-0234-47f2-a683-71ef82d15401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2131213719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb02a9c-2b17-49b7-8b54-5a04d712a4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e39bcbb4bd44589aae300565e21d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:19Z,use_quota=True,user_id='613a74d695e34a9786144ebf95365dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4dd4dc-bdbc-4258-b66a-ebf885310367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b4dd4dc-bdbc-4258-b66a-ebf885310367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec92fbc-5693-4e12-aed8-b8ec958c0137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec92fbc-5693-4e12-aed8-b8ec958c0137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb02a9c-2b17-49b7-8b54-5a04d712a4e7', 'volume_name': 'volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67636434-1630-4b81-9e3f-4734f068a173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67636434-1630-4b81-9e3f-4734f068a173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a36ced-e754-4cc5-bf7f-0277eb4ee4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:19 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Volume 9cb02a9c-2b17-49b7-8b54-5a04d712a4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7', 'volume_size': 1}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2131213719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb02a9c-2b17-49b7-8b54-5a04d712a4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e39bcbb4bd44589aae300565e21d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:19Z,use_quota=True,user_id='613a74d695e34a9786144ebf95365dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Creating volume 9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:19 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:27:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:19 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 1073741824
Jun 24 04:27:19 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:20 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 1073741824" returned: 0 in 0.881s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:20 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7
Jun 24 04:27:20 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:20 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" returned: 0 in 0.662s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a36ced-e754-4cc5-bf7f-0277eb4ee4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27027084-985c-4010-be45-af6b4072f70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:20 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Volume volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 (9cb02a9c-2b17-49b7-8b54-5a04d712a4e7): created successfully
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27027084-985c-4010-be45-af6b4072f70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:20 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (2e07ddf5-c1ba-4079-9f3a-99790ebd29a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8f21ab86-c1c8-430e-b9f0-46a1f38285ae tempest-VolumesSnapshotTestJSON-1218858181 None] Created volume successfully.
Jun 24 04:27:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Creating offline snapshot 2546d83d-d1f2-4bfe-98d7-b879a69b9638 of volume 9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:27:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e93450-d5d8-4944-bd0c-3effd2cf42df]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:21 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7
Jun 24 04:27:21 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4eeef5f5-c174-48a5-960f-1ac01ebd9237 tempest-GroupsTest-1953858312 None] Group tempest-Group1-1811764759: creating
Jun 24 04:27:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4eeef5f5-c174-48a5-960f-1ac01ebd9237 tempest-GroupsTest-1953858312 None] Group tempest-Group1-1811764759: created successfully
Jun 24 04:27:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4eeef5f5-c174-48a5-960f-1ac01ebd9237 tempest-GroupsTest-1953858312 None] Create group completed successfully.
Jun 24 04:27:22 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" returned: 0 in 0.803s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:22 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 1G
Jun 24 04:27:22 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:23 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 1G" returned: 0 in 0.898s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:23 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638
Jun 24 04:27:23 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6ba54557-6918-43f1-b64b-5d9ab7041583 tempest-GroupsTest-1953858312 None] Group tempest-Group2-1764926943: creating
Jun 24 04:27:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6ba54557-6918-43f1-b64b-5d9ab7041583 tempest-GroupsTest-1953858312 None] Group tempest-Group2-1764926943: created successfully
Jun 24 04:27:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6ba54557-6918-43f1-b64b-5d9ab7041583 tempest-GroupsTest-1953858312 None] Create group completed successfully.
Jun 24 04:27:24 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638" returned: 0 in 0.988s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:24 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 is being set with open permissions: ugo+rw
Jun 24 04:27:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:24 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638
Jun 24 04:27:24 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:25 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638" returned: 0 in 0.808s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:25 devstack sudo[108339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.info
Jun 24 04:27:25 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Flow 'volume_create_manager' (584f8af2-1432-4bfe-9867-2b7b90482eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9664255-9f10-497e-b57b-d3aa49123d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9664255-9f10-497e-b57b-d3aa49123d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062526182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8e171366-66da-4e87-bf52-b04fe28882d1,host='devstack@QuobyteHD#QuobyteHD',id=f6d11ee1-fc10-40a1-9c2d-76e84699d0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29fb03b14504f36b367f43c186ec756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:25Z,use_quota=True,user_id='c157beb240114915865855879585b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a12a884-d52e-40cb-b9d6-59d9d760a09e),volume_type_id=8a12a884-d52e-40cb-b9d6-59d9d760a09e)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e5277b-1346-41d9-80e7-d0babc09e56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e5277b-1346-41d9-80e7-d0babc09e56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232d3f93-5d2e-4f64-a269-0fc768d29ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232d3f93-5d2e-4f64-a269-0fc768d29ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d11ee1-fc10-40a1-9c2d-76e84699d0d4', 'volume_name': 'volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15cd929-e626-4990-acb4-0d79920b07e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15cd929-e626-4990-acb4-0d79920b07e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1be2c8f-24d4-431a-92be-8a2ccd82d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:25 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Volume f6d11ee1-fc10-40a1-9c2d-76e84699d0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4', 'volume_size': 1}
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:25 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.info" returned: 0 in 0.776s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:25 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.info is being set with open permissions: ugo+rw
Jun 24 04:27:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:25 devstack sudo[108349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.info
Jun 24 04:27:25 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:26 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.info" returned: 0 in 0.742s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.135s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8e171366-66da-4e87-bf52-b04fe28882d1,created_at=2026-06-24T02:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062526182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8e171366-66da-4e87-bf52-b04fe28882d1,host='devstack@QuobyteHD#QuobyteHD',id=f6d11ee1-fc10-40a1-9c2d-76e84699d0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29fb03b14504f36b367f43c186ec756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:25Z,use_quota=True,user_id='c157beb240114915865855879585b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a12a884-d52e-40cb-b9d6-59d9d760a09e),volume_type_id=8a12a884-d52e-40cb-b9d6-59d9d760a09e)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Creating volume f6d11ee1-fc10-40a1-9c2d-76e84699d0d4 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:26 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:27:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:26 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4 1073741824
Jun 24 04:27:26 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d90e6453-78d0-4abc-8624-197d34de326d tempest-VolumesSnapshotTestJSON-1218858181 None] Create snapshot completed successfully
Jun 24 04:27:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-806aed39-e9f9-4687-a688-becc3a674b80 req-b00f47b0-c46d-47b2-96bc-13e92f2dff79 tempest-TestShelveInstance-1387224078 None] Terminate volume connection completed successfully.
Jun 24 04:27:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-806aed39-e9f9-4687-a688-becc3a674b80 req-b00f47b0-c46d-47b2-96bc-13e92f2dff79 tempest-TestShelveInstance-1387224078 None] Deleting attachment e38e9687-ec72-40dd-9145-82dc5e452f1a. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:27:27 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4 1073741824" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:27 devstack sudo[108359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4
Jun 24 04:27:27 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Acquiring lock "cinder-9940df70-2037-4263-b692-be6889dcff66-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Lock "cinder-9940df70-2037-4263-b692-be6889dcff66-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Acquiring lock "cinder-quobyte-9940df70-2037-4263-b692-be6889dcff66" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:27 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Lock "cinder-quobyte-9940df70-2037-4263-b692-be6889dcff66" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-2546d83d-d1f2-4bfe-98d7-b879a69b9638-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-2546d83d-d1f2-4bfe-98d7-b879a69b9638-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f35428-a4e5-4d16-ae65-612c3f9b3cad]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-2546d83d-d1f2-4bfe-98d7-b879a69b9638" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-2546d83d-d1f2-4bfe-98d7-b879a69b9638" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Deleting offline snapshot 2546d83d-d1f2-4bfe-98d7-b879a69b9638 of volume 9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] snapshot_file for this snap is: volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[629cd0ea-97dd-4803-99a0-c870a45e1b00]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:28 devstack sudo[108361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:27:28 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:28 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638
Jun 24 04:27:28 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:28 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1be2c8f-24d4-431a-92be-8a2ccd82d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c153923a-4324-4ab2-b417-2b85c5161692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Volume volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4 (f6d11ee1-fc10-40a1-9c2d-76e84699d0d4): created successfully
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c153923a-4324-4ab2-b417-2b85c5161692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Flow 'volume_create_manager' (584f8af2-1432-4bfe-9867-2b7b90482eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d24e7344-b2ab-4934-81a5-d8c4ff5ce2e9 tempest-GroupsTest-1953858312 None] Created volume successfully.
Jun 24 04:27:28 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 0 in 0.863s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:28 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2ca5bb-2b92-49d8-8842-836ea3afa1eb]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:29 devstack sudo[108371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:27:29 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:29 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7
Jun 24 04:27:29 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Acquiring lock "cinder-quobyte-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Lock "cinder-quobyte-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4625b36e-c693-40f1-9d80-237a12aeea4b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:29 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4
Jun 24 04:27:29 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:29 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 1 in 0.918s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:29 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66
Jun 24 04:27:29 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:29 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" returned: 0 in 0.860s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:29 devstack sudo[108385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638
Jun 24 04:27:29 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:30 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4" returned: 0 in 0.944s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:30 devstack sudo[108392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4
Jun 24 04:27:30 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:30 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9940df70-2037-4263-b692-be6889dcff66" returned: 0 in 0.728s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Lock "cinder-quobyte-9940df70-2037-4263-b692-be6889dcff66" released by "delete_volume" :: held 2.599s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG cinder.quota [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Created reservations ['ed59f77b-c16d-4f3e-9cc0-b380f16efe0f', '8de1a123-7b25-461d-b7b2-70726f064f3c', '9c730565-1fde-490f-8601-a00b48c31d6a', '6d84116f-ce78-4b11-9ce3-fda4fe54f5b6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:30 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638" returned: 0 in 0.858s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:30 devstack sudo[108398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638
Jun 24 04:27:30 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:30 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:30 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:31 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4" returned: 0 in 0.921s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Lock "cinder-quobyte-f6d11ee1-fc10-40a1-9c2d-76e84699d0d4" released by "delete_volume" :: held 1.924s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Created reservations ['984f85ee-3e43-44c8-97a0-abd7a58fbc2d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:31 devstack cinder-volume[93468]: WARNING cinder.quota [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-22851537 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-22851537, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:27:31 devstack cinder-volume[93468]: WARNING cinder.quota [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-22851537 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-22851537, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Created reservations ['8a58a2cb-59e6-45ef-9710-c8e2a1af0cc5', '65c2f678-7809-48cd-8ff3-92bb5b8cca91', '8d3d6a40-3cda-4b83-b910-1642e9994901', 'ce9e062a-402e-4fdf-abbc-bf632f18dfd4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:31 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.manager [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Deleted volume successfully.
Jun 24 04:27:31 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7.2546d83d-d1f2-4bfe-98d7-b879a69b9638" returned: 0 in 0.869s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [req-806aed39-e9f9-4687-a688-becc3a674b80 req-e74f0ef4-f12d-404d-acc8-807cb2dbfc53 tempest-TestShelveInstance-1387224078 None] Lock "cinder-9940df70-2037-4263-b692-be6889dcff66-delete_volume" released by "delete_volume" :: held 3.799s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:31 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:31 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-2546d83d-d1f2-4bfe-98d7-b879a69b9638" released by "_delete_snapshot" :: held 3.674s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" released by "delete_snapshot" :: held 3.707s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Created reservations ['b9080cdd-829b-492e-9852-e23f8501faee', '11bac357-6f7e-4624-b7a7-614a18d30b8b', '37f89faa-520f-4ee0-8a04-094de403ca87', 'ffe6e019-86b5-46a4-b428-48fadf965e2b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Delete snapshot completed successfully.
Jun 24 04:27:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8f7493dd-0497-4a28-ab35-b8f50b610451 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-2546d83d-d1f2-4bfe-98d7-b879a69b9638-delete_snapshot" released by "delete_snapshot" :: held 3.968s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Created reservations ['8500cebb-a752-434a-83a9-741d4270e09b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:32 devstack sudo[108407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:32 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:32 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.878s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1c49ec9e-01e0-484c-8c95-ef5ae43b0b5c tempest-GroupsTest-1953858312 None] Delete group completed successfully.
Jun 24 04:27:32 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:32 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a58c0d60-0e29-4cbd-86fc-8f30d18a4f01 tempest-GroupsTest-1953858312 None] Delete group completed successfully.
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (33d159f9-938f-4426-a8f9-22283a9c9906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bed79e-bc79-42bd-b83a-ceab3ef212fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bed79e-bc79-42bd-b83a-ceab3ef212fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-223194772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e39bcbb4bd44589aae300565e21d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:33Z,use_quota=True,user_id='613a74d695e34a9786144ebf95365dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e480fc88-2886-4f8d-a45c-5e3f2ed8443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e480fc88-2886-4f8d-a45c-5e3f2ed8443f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1172297-aaa5-4b87-9056-0af27b32a269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1172297-aaa5-4b87-9056-0af27b32a269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910', 'volume_name': 'volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbf544d-dacc-4fd7-9456-c826d422b630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbf544d-dacc-4fd7-9456-c826d422b630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4c9809-6ce7-4a50-8403-0ad27142dfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910', 'volume_size': 1}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-223194772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e39bcbb4bd44589aae300565e21d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:33Z,use_quota=True,user_id='613a74d695e34a9786144ebf95365dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Creating volume ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:33 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:27:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:33 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 1073741824
Jun 24 04:27:33 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-72bdf94c-b7d9-4658-8477-76e4ade68fc8 tempest-GroupsTest-1953858312 None] Group tempest-GroupsTest-Group-330665157: creating
Jun 24 04:27:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-72bdf94c-b7d9-4658-8477-76e4ade68fc8 tempest-GroupsTest-1953858312 None] Group tempest-GroupsTest-Group-330665157: created successfully
Jun 24 04:27:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-72bdf94c-b7d9-4658-8477-76e4ade68fc8 tempest-GroupsTest-1953858312 None] Create group completed successfully.
Jun 24 04:27:34 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 1073741824" returned: 0 in 1.011s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:34 devstack sudo[108420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910
Jun 24 04:27:34 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:34 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" returned: 0 in 0.737s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4c9809-6ce7-4a50-8403-0ad27142dfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d067571-26ae-4432-a6b7-dc69ec8828eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 (ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910): created successfully
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d067571-26ae-4432-a6b7-dc69ec8828eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (33d159f9-938f-4426-a8f9-22283a9c9906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-477fde8c-2178-47b5-9487-1462352db131 tempest-VolumesSnapshotTestJSON-1218858181 None] Created volume successfully.
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Flow 'volume_create_manager' (10ffab6b-3efb-4f10-9165-8e95e124f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfda210-9a28-494e-928b-eabe09d0bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfda210-9a28-494e-928b-eabe09d0bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2060750768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9ebc7dee-d046-41e9-8206-452f10d4154b,host='devstack@QuobyteHD#QuobyteHD',id=e4257349-f6e5-4585-bf36-f695627e3a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29fb03b14504f36b367f43c186ec756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:35Z,use_quota=True,user_id='c157beb240114915865855879585b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5bb2414-b7fb-4fb7-899c-b0f38bd879a4),volume_type_id=b5bb2414-b7fb-4fb7-899c-b0f38bd879a4)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370af9cb-c37f-4058-a037-3ce010b050b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370af9cb-c37f-4058-a037-3ce010b050b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c2eb18-73cf-4a77-990d-92e0c5b724b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c2eb18-73cf-4a77-990d-92e0c5b724b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4257349-f6e5-4585-bf36-f695627e3a75', 'volume_name': 'volume-e4257349-f6e5-4585-bf36-f695627e3a75', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb85016-7fbd-40c5-bd64-08b1d3d158e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb85016-7fbd-40c5-bd64-08b1d3d158e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a25ea2e-51ec-4ae7-8d32-fe3fb03dd494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Volume e4257349-f6e5-4585-bf36-f695627e3a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4257349-f6e5-4585-bf36-f695627e3a75', 'volume_size': 1}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9ebc7dee-d046-41e9-8206-452f10d4154b,created_at=2026-06-24T02:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2060750768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9ebc7dee-d046-41e9-8206-452f10d4154b,host='devstack@QuobyteHD#QuobyteHD',id=e4257349-f6e5-4585-bf36-f695627e3a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29fb03b14504f36b367f43c186ec756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:35Z,use_quota=True,user_id='c157beb240114915865855879585b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5bb2414-b7fb-4fb7-899c-b0f38bd879a4),volume_type_id=b5bb2414-b7fb-4fb7-899c-b0f38bd879a4)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Creating volume e4257349-f6e5-4585-bf36-f695627e3a75 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:35 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:27:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:35 devstack sudo[108425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75 1073741824
Jun 24 04:27:35 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:36 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75 1073741824" returned: 0 in 1.073s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:36 devstack sudo[108432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75
Jun 24 04:27:36 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:37 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75" returned: 0 in 0.748s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Creating offline snapshot 4cb83fcd-89dd-477a-9b4b-362544f979d5 of volume ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a25ea2e-51ec-4ae7-8d32-fe3fb03dd494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4257349-f6e5-4585-bf36-f695627e3a75', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1a60c7-9ae4-4c3e-885b-631e7b40f8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c5aec-8a18-43e7-b451-0b1eb415099a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Volume volume-e4257349-f6e5-4585-bf36-f695627e3a75 (e4257349-f6e5-4585-bf36-f695627e3a75): created successfully
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1a60c7-9ae4-4c3e-885b-631e7b40f8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Flow 'volume_create_manager' (10ffab6b-3efb-4f10-9165-8e95e124f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8ffa42c3-795b-46b3-8086-2466a671843b tempest-GroupsTest-1953858312 None] Created volume successfully.
Jun 24 04:27:37 devstack sudo[108436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910
Jun 24 04:27:37 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:38 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" returned: 0 in 0.852s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:38 devstack sudo[108441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 1G
Jun 24 04:27:38 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Flow 'volume_create_manager' (f59e63c8-9cb6-4216-8b42-8f691998c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7495630c-d6f4-4d80-93ef-38e74583dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7495630c-d6f4-4d80-93ef-38e74583dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-662630851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9ebc7dee-d046-41e9-8206-452f10d4154b,host='devstack@QuobyteHD#QuobyteHD',id=ceaa71f3-3b06-467c-a838-102d22f7c073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29fb03b14504f36b367f43c186ec756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:39Z,use_quota=True,user_id='c157beb240114915865855879585b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5bb2414-b7fb-4fb7-899c-b0f38bd879a4),volume_type_id=b5bb2414-b7fb-4fb7-899c-b0f38bd879a4)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c348dc-fd8b-49f1-88aa-a1dbff70d879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c348dc-fd8b-49f1-88aa-a1dbff70d879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376cffa5-2c75-45cc-a675-616512765623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376cffa5-2c75-45cc-a675-616512765623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceaa71f3-3b06-467c-a838-102d22f7c073', 'volume_name': 'volume-ceaa71f3-3b06-467c-a838-102d22f7c073', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4541d361-ce7c-4c30-addd-700beab4345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4541d361-ce7c-4c30-addd-700beab4345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a6987d-04a0-4e10-b2a3-43db5c152e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Volume ceaa71f3-3b06-467c-a838-102d22f7c073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceaa71f3-3b06-467c-a838-102d22f7c073', 'volume_size': 1}
Jun 24 04:27:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:39 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 1G" returned: 0 in 0.973s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:39 devstack sudo[108447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5
Jun 24 04:27:39 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:40 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5" returned: 0 in 0.814s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:40 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 is being set with open permissions: ugo+rw
Jun 24 04:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:40 devstack sudo[108454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5
Jun 24 04:27:40 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:40 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5" returned: 0 in 0.683s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:40 devstack sudo[108457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.info
Jun 24 04:27:40 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:41 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.info" returned: 0 in 0.710s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:41 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.info is being set with open permissions: ugo+rw
Jun 24 04:27:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:41 devstack sudo[108460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.info
Jun 24 04:27:41 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:42 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.info" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.810s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.365s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9ebc7dee-d046-41e9-8206-452f10d4154b,created_at=2026-06-24T02:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-662630851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9ebc7dee-d046-41e9-8206-452f10d4154b,host='devstack@QuobyteHD#QuobyteHD',id=ceaa71f3-3b06-467c-a838-102d22f7c073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29fb03b14504f36b367f43c186ec756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:39Z,use_quota=True,user_id='c157beb240114915865855879585b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b5bb2414-b7fb-4fb7-899c-b0f38bd879a4),volume_type_id=b5bb2414-b7fb-4fb7-899c-b0f38bd879a4)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Creating volume ceaa71f3-3b06-467c-a838-102d22f7c073 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:27:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:42 devstack sudo[108463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073 1073741824
Jun 24 04:27:42 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7632399e-9dfe-473a-ab68-b171313b6bff tempest-VolumesSnapshotTestJSON-1218858181 None] Create snapshot completed successfully
Jun 24 04:27:43 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073 1073741824" returned: 0 in 0.873s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:43 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073
Jun 24 04:27:43 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (f8cdb268-c657-49a0-bcbb-339cee97b741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d52d24b-bfd6-429b-84e5-a22035e5d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d52d24b-bfd6-429b-84e5-a22035e5d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-570473775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a39a6c-fca4-48a2-bb3c-7f0df1338aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e39bcbb4bd44589aae300565e21d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4cb83fcd-89dd-477a-9b4b-362544f979d5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:43Z,use_quota=True,user_id='613a74d695e34a9786144ebf95365dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e297b584-15dd-4a5c-a96d-041e21bc5e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e297b584-15dd-4a5c-a96d-041e21bc5e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a906210c-1b0f-4165-81ef-97f6bb19410b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a906210c-1b0f-4165-81ef-97f6bb19410b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42a39a6c-fca4-48a2-bb3c-7f0df1338aad', 'volume_name': 'volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad', 'volume_size': 2, 'snapshot_id': '4cb83fcd-89dd-477a-9b4b-362544f979d5'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4e0b47-6810-4462-9029-8185831cca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4e0b47-6810-4462-9029-8185831cca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0625c51d-61b3-4150-86a2-797efdbc13af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume 42a39a6c-fca4-48a2-bb3c-7f0df1338aad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad', 'volume_size': 2, 'snapshot_id': '4cb83fcd-89dd-477a-9b4b-362544f979d5'}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:43 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073" returned: 0 in 0.694s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.455s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-4cb83fcd-89dd-477a-9b4b-362544f979d5-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a6987d-04a0-4e10-b2a3-43db5c152e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceaa71f3-3b06-467c-a838-102d22f7c073', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74043e3-7c4b-40e9-835d-6bb431ad76a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-4cb83fcd-89dd-477a-9b4b-362544f979d5-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Creating volume 42a39a6c-fca4-48a2-bb3c-7f0df1338aad from snapshot 4cb83fcd-89dd-477a-9b4b-362544f979d5 {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Volume volume-ceaa71f3-3b06-467c-a838-102d22f7c073 (ceaa71f3-3b06-467c-a838-102d22f7c073): created successfully
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74043e3-7c4b-40e9-835d-6bb431ad76a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Flow 'volume_create_manager' (f59e63c8-9cb6-4216-8b42-8f691998c78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] snapshot: 4cb83fcd-89dd-477a-9b4b-362544f979d5, volume: 42a39a6c-fca4-48a2-bb3c-7f0df1338aad,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:27:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-db689e7a-824c-44cd-a818-9fcebc99ab59 tempest-GroupsTest-1953858312 None] Created volume successfully.
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3204a3-dd4f-4837-a649-0e67352c7659]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:44 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5
Jun 24 04:27:44 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2691db6a-3fcd-431f-9990-125e2c12407e tempest-GroupsTest-1953858312 None] Update group completed successfully.
Jun 24 04:27:44 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:27:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:27:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9847dfd4-5bc2-4250-aad6-bea1189148b6]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:44 devstack sudo[108479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910
Jun 24 04:27:44 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:45 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:45 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:27:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:45 devstack sudo[108484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad
Jun 24 04:27:45 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-75fe0416-1d64-4f40-95af-f42356c24db6 tempest-GroupsTest-1953858312 None] Update group completed successfully.
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Flow 'volume_create_manager' (fa776333-2b04-4924-8ba8-b8bd86334690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1924bb5d-3b5d-4feb-a0ba-cb908145c3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1924bb5d-3b5d-4feb-a0ba-cb908145c3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0077ca1a-2a69-4225-badc-c7f5c7f542e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b0b57a37c643e2a020b51f527197ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:46Z,use_quota=True,user_id='c345664cc2514862b17176a32e2ee836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04796c7e-2a9a-4e59-b07f-dd89297e7d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04796c7e-2a9a-4e59-b07f-dd89297e7d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42b166c-f19b-4eaa-afd6-a2c003135d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42b166c-f19b-4eaa-afd6-a2c003135d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0077ca1a-2a69-4225-badc-c7f5c7f542e3', 'volume_name': 'volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3', 'volume_size': 1, 'image_id': '74cde56e-046f-43bf-942c-6858c7b7b05a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74cde56e-046f-43bf-942c-6858c7b7b05a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5483d2af162f336920d44a39ed77d376', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16b0b57a37c643e2a020b51f527197ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c0c69aba7130199202a0deab20ebed81e9de56dcefe63fe59c8c7d7076d671716561ee2b1c98b085798d7b573da507d9862f718c747bb8dacdc302cf9da65f2', 'id': '74cde56e-046f-43bf-942c-6858c7b7b05a', 'created_at': datetime.datetime(2026, 6, 24, 2, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74cde56e-046f-43bf-942c-6858c7b7b05a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f081e990>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbc49a5-9776-41b0-8211-fb57894e1724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbc49a5-9776-41b0-8211-fb57894e1724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237420c5-a1ec-44f8-a525-720e7c9387c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Volume 0077ca1a-2a69-4225-badc-c7f5c7f542e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3', 'volume_size': 1, 'image_id': '74cde56e-046f-43bf-942c-6858c7b7b05a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74cde56e-046f-43bf-942c-6858c7b7b05a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5483d2af162f336920d44a39ed77d376', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16b0b57a37c643e2a020b51f527197ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c0c69aba7130199202a0deab20ebed81e9de56dcefe63fe59c8c7d7076d671716561ee2b1c98b085798d7b573da507d9862f718c747bb8dacdc302cf9da65f2', 'id': '74cde56e-046f-43bf-942c-6858c7b7b05a', 'created_at': datetime.datetime(2026, 6, 24, 2, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74cde56e-046f-43bf-942c-6858c7b7b05a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f081e990>}
Jun 24 04:27:46 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Trying to clone 0077ca1a-2a69-4225-badc-c7f5c7f542e3 from image 74cde56e-046f-43bf-942c-6858c7b7b05a at location (None, [{'url': 'file:///opt/stack/data/glance/images/74cde56e-046f-43bf-942c-6858c7b7b05a', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:27:47 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:27:47 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Image download 0.00 MB at 0.00 MB/s
Jun 24 04:27:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe798bcb-2f16-4354-8113-f56ecb26fbfc]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:47 devstack sudo[108497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD
Jun 24 04:27:47 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Acquiring lock "cinder-quobyte-ceaa71f3-3b06-467c-a838-102d22f7c073" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Lock "cinder-quobyte-ceaa71f3-3b06-467c-a838-102d22f7c073" acquired by "delete_volume" :: waited 0.035s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fefd34-127c-4247-967e-d4f19b3b11fb]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:48 devstack sudo[108535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073
Jun 24 04:27:48 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:48 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD" returned: 0 in 1.852s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:49 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD
Jun 24 04:27:49 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:50 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073" returned: 0 in 1.666s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:50 devstack sudo[108545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073
Jun 24 04:27:50 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:51 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD" returned: 1 in 2.368s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Temporary image 74cde56e-046f-43bf-942c-6858c7b7b05a is fetched for user c345664cc2514862b17176a32e2ee836. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4e492c-7a93-489c-9b24-fed4fdcdc825]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:51 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ceaa71f3-3b06-467c-a838-102d22f7c073" returned: 0 in 1.201s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:51 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Lock "cinder-quobyte-ceaa71f3-3b06-467c-a838-102d22f7c073" released by "delete_volume" :: held 2.988s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Acquiring lock "cinder-quobyte-e4257349-f6e5-4585-bf36-f695627e3a75" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" returned: 0 in 5.914s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Lock "cinder-quobyte-e4257349-f6e5-4585-bf36-f695627e3a75" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7b525e-3c40-4cbc-b8d7-5cc48a11df27]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4db1b-b38d-4fd0-9765-16dc1d481803]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:51 devstack sudo[108551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD
Jun 24 04:27:51 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:51 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910
Jun 24 04:27:51 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:51 devstack sudo[108553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75
Jun 24 04:27:51 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:52 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:52 devstack sudo[108563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD
Jun 24 04:27:52 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:52 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75" returned: 0 in 0.816s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:52 devstack sudo[108567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75
Jun 24 04:27:52 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:52 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" returned: 0 in 0.909s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:27:52 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Converted 1024.00 MB image at 173.13 MB/s
Jun 24 04:27:52 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad is being set with open permissions: ugo+rw
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:52 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad
Jun 24 04:27:52 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:52 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:27:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:53 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" returned: 0 in 0.628s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" released by "_copy_volume_from_snapshot" :: held 9.152s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:53 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e4257349-f6e5-4585-bf36-f695627e3a75" returned: 0 in 0.725s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-4cb83fcd-89dd-477a-9b4b-362544f979d5-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" released by "_create_volume_from_snapshot" :: held 9.213s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.248s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0077ca1a-2a69-4225-badc-c7f5c7f542e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b0b57a37c643e2a020b51f527197ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:27:46Z,use_quota=True,user_id='c345664cc2514862b17176a32e2ee836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Creating volume 0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:27:53 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Lock "cinder-quobyte-e4257349-f6e5-4585-bf36-f695627e3a75" released by "delete_volume" :: held 1.623s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:53 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 1073741824
Jun 24 04:27:53 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0625c51d-61b3-4150-86a2-797efdbc13af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad', 'volume_size': 2, 'snapshot_id': '4cb83fcd-89dd-477a-9b4b-362544f979d5'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00545a26-4416-4bae-a6e7-44abd3556d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:27:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad (42a39a6c-fca4-48a2-bb3c-7f0df1338aad): created successfully
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00545a26-4416-4bae-a6e7-44abd3556d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (f8cdb268-c657-49a0-bcbb-339cee97b741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:27:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-39505f0d-f7e7-480d-b203-59bca94ecef2 tempest-VolumesSnapshotTestJSON-1218858181 None] Created volume successfully.
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Created reservations ['a06f931f-5c62-4edb-b608-b940d1edbdf0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:53 devstack cinder-volume[93468]: WARNING cinder.quota [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2045184584 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2045184584, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:27:53 devstack cinder-volume[93468]: WARNING cinder.quota [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2045184584 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2045184584, it is now deprecated. Please use the default quota class for default quota.
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Created reservations ['7f657754-c3be-4b58-a15c-ca20ac38fb53', 'c113ee06-1cea-4cba-b304-5d6066bf133c', '3820e6e0-2a38-4e10-902d-7e1f338fc5e6', '2491b207-fe70-4c17-9b13-fbce35130714'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Created reservations ['bb02e236-cf37-46b0-b628-d6c78ff2f42d', '17d5068e-a9e7-48d7-8271-0685c4ae5b41', '99475078-f4ad-4b78-8143-22d59f307b6e', '2040ac29-44ef-4c26-ad0d-e84793eb522d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:53 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:53 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:54 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 1073741824" returned: 0 in 0.964s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:54 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3
Jun 24 04:27:54 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:54 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.744s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dc195b76-9620-4a67-acaa-2cd47786b19e tempest-GroupsTest-1953858312 None] Delete group completed successfully.
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-42a39a6c-fca4-48a2-bb3c-7f0df1338aad-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-42a39a6c-fca4-48a2-bb3c-7f0df1338aad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e308897-3f4a-4281-9e95-5c6f8ef11c08]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:54 devstack sudo[108587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad
Jun 24 04:27:54 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:54 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3" returned: 0 in 0.746s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Attempting download of 74cde56e-046f-43bf-942c-6858c7b7b05a ((None, [{'url': 'file:///opt/stack/data/glance/images/74cde56e-046f-43bf-942c-6858c7b7b05a', 'metadata': {}}])) to volume 0077ca1a-2a69-4225-badc-c7f5c7f542e3. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87032f1-f13d-48f4-bf01-6cb2dffa6333]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74cde56e-046f-43bf-942c-6858c7b7b05a_aq0py0jz {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:55 devstack sudo[108591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74cde56e-046f-43bf-942c-6858c7b7b05a_aq0py0jz
Jun 24 04:27:55 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:55 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" returned: 0 in 0.964s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:55 devstack sudo[108597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad
Jun 24 04:27:55 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:55 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74cde56e-046f-43bf-942c-6858c7b7b05a_aq0py0jz" returned: 0 in 0.825s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74cde56e-046f-43bf-942c-6858c7b7b05a_aq0py0jz {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:55 devstack sudo[108601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74cde56e-046f-43bf-942c-6858c7b7b05a_aq0py0jz
Jun 24 04:27:55 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:56 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" returned: 0 in 0.767s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-42a39a6c-fca4-48a2-bb3c-7f0df1338aad" released by "delete_volume" :: held 1.787s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Created reservations ['137aa548-d6df-42d2-a335-b7aa8828d334', '7e19d323-bf37-4236-92e2-240ed1c99ac5', '166a287b-f464-41da-97bc-e4e1eac9efe7', '4a82dc04-ac7a-4cc3-8f19-0665b7c9526e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:56 devstack sudo[108604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:27:56 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-4cb83fcd-89dd-477a-9b4b-362544f979d5-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-4cb83fcd-89dd-477a-9b4b-362544f979d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-4cb83fcd-89dd-477a-9b4b-362544f979d5" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:27:56 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74cde56e-046f-43bf-942c-6858c7b7b05a_aq0py0jz" returned: 1 in 1.005s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74cde56e-046f-43bf-942c-6858c7b7b05a_aq0py0jz' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-4cb83fcd-89dd-477a-9b4b-362544f979d5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Deleting offline snapshot 4cb83fcd-89dd-477a-9b4b-362544f979d5 of volume ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] snapshot_file for this snap is: volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff73cc2-96f0-4947-b74d-a43252e7420a]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0213e9fe-647c-4587-8932-10afdab0e2a9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:56 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD
Jun 24 04:27:56 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:57 devstack sudo[108609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5
Jun 24 04:27:57 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:57 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:27:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Deleted volume successfully.
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-bf7a29ed-384a-4588-a103-19ba07d2d65d tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-42a39a6c-fca4-48a2-bb3c-7f0df1338aad-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:27:57 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:57 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5" returned: 0 in 0.894s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:27:57 devstack sudo[108618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD
Jun 24 04:27:57 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6e8e21-1786-4bc5-9e9d-e801549accf0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:27:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:57 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910
Jun 24 04:27:57 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:58 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:27:58 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] 74cde56e-046f-43bf-942c-6858c7b7b05a was raw, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:58 devstack sudo[108625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3
Jun 24 04:27:58 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:58 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" returned: 0 in 0.837s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:58 devstack sudo[108630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5
Jun 24 04:27:58 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:59 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3" returned: 0 in 0.792s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:59 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74cde56e-046f-43bf-942c-6858c7b7b05a_o2fley_gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:27:59 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Converted 0.00 MB image at 0.00 MB/s
Jun 24 04:27:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:59 devstack sudo[108639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 1G
Jun 24 04:27:59 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:27:59 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root
Jun 24 04:27:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5" returned: 0 in 0.785s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:27:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:27:59 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5
Jun 24 04:27:59 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:00 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 1G" returned: 0 in 0.768s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a66eae-5fb5-4c1d-9677-2c2c7ad8856e]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:00 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910.4cb83fcd-89dd-477a-9b4b-362544f979d5" returned: 0 in 0.660s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=114,cinder:INSERT=34,cinder:UPDATE=130,cinder:DELETE=9 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=116,cinder:UPDATE=118,cinder:INSERT=24,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-4cb83fcd-89dd-477a-9b4b-362544f979d5" released by "_delete_snapshot" :: held 3.331s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" released by "delete_snapshot" :: held 3.374s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:00 devstack sudo[108647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3
Jun 24 04:28:00 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Created reservations ['fe18fd02-4a26-4596-b764-a5e204a88b85', 'efae7484-908c-4be9-97ed-9d85b5a206f6', 'a1cb2fa3-234f-41a5-8cf5-d53e9337040c', '12124bdd-bffb-4feb-a3ce-ab4c442c5276'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Delete snapshot completed successfully.
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5c0903ed-6f2c-48b6-aaf0-1eb5dc75e6db tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-4cb83fcd-89dd-477a-9b4b-362544f979d5-delete_snapshot" released by "delete_snapshot" :: held 3.527s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:00 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3" returned: 0 in 0.870s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:01 devstack sudo[108651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3
Jun 24 04:28:01 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" acquired by "delete_volume" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a077e22c-4078-46a9-b0b9-baa8a691cccd]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:01 devstack sudo[108653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910
Jun 24 04:28:01 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:01 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:01 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:01 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3" returned: 1 in 1.056s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Downloaded image 74cde56e-046f-43bf-942c-6858c7b7b05a ((None, [{'url': 'file:///opt/stack/data/glance/images/74cde56e-046f-43bf-942c-6858c7b7b05a', 'metadata': {}}])) to volume 0077ca1a-2a69-4225-badc-c7f5c7f542e3 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Temporary image 74cde56e-046f-43bf-942c-6858c7b7b05a for user c345664cc2514862b17176a32e2ee836 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Marking volume 0077ca1a-2a69-4225-badc-c7f5c7f542e3 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Copying metadata from image 74cde56e-046f-43bf-942c-6858c7b7b05a to 0077ca1a-2a69-4225-badc-c7f5c7f542e3. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Creating volume glance metadata for volume 0077ca1a-2a69-4225-badc-c7f5c7f542e3 backed by image 74cde56e-046f-43bf-942c-6858c7b7b05a with: {'image_id': '74cde56e-046f-43bf-942c-6858c7b7b05a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5483d2af162f336920d44a39ed77d376', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237420c5-a1ec-44f8-a525-720e7c9387c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3', 'volume_size': 1, 'image_id': '74cde56e-046f-43bf-942c-6858c7b7b05a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74cde56e-046f-43bf-942c-6858c7b7b05a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5483d2af162f336920d44a39ed77d376', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16b0b57a37c643e2a020b51f527197ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c0c69aba7130199202a0deab20ebed81e9de56dcefe63fe59c8c7d7076d671716561ee2b1c98b085798d7b573da507d9862f718c747bb8dacdc302cf9da65f2', 'id': '74cde56e-046f-43bf-942c-6858c7b7b05a', 'created_at': datetime.datetime(2026, 6, 24, 2, 27, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 27, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74cde56e-046f-43bf-942c-6858c7b7b05a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f081e990>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2d1c62-7022-4e1f-8718-99f454a25c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:02 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Volume volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 (0077ca1a-2a69-4225-badc-c7f5c7f542e3): created successfully
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2d1c62-7022-4e1f-8718-99f454a25c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Flow 'volume_create_manager' (fa776333-2b04-4924-8ba8-b8bd86334690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:02 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dc616ca1-f0d7-4fd1-a10a-77a5aa4b3c04 tempest-VolumeImageDependencyTests-55371122 None] Created volume successfully.
Jun 24 04:28:02 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" returned: 0 in 0.940s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:02 devstack sudo[108663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910
Jun 24 04:28:02 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:02 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.823s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Acquiring lock "cinder-0077ca1a-2a69-4225-badc-c7f5c7f542e3-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Lock "cinder-0077ca1a-2a69-4225-badc-c7f5c7f542e3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Acquiring lock "cinder-quobyte-0077ca1a-2a69-4225-badc-c7f5c7f542e3" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Lock "cinder-quobyte-0077ca1a-2a69-4225-badc-c7f5c7f542e3" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d620154-cd3a-4ea0-a20c-af99c6ede58c]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:03 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" returned: 0 in 0.794s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:03 devstack sudo[108667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3
Jun 24 04:28:03 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910" released by "delete_volume" :: held 1.832s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Created reservations ['abe1c5ab-002b-4998-a681-f6413d666f33', '08de604a-bd25-4be9-a2b4-da4971654011', '917784af-d7e9-415b-ad8f-a083538713cc', '2ec9e7b2-e75b-4c00-bc15-ef567909bd5f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:03 devstack sudo[108669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:03 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:03 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3" returned: 0 in 0.915s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:04 devstack sudo[108673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3
Jun 24 04:28:04 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:04 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (a6944927-1ada-45dd-bb25-ae9c03f2304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080d289a-ddf5-4cc7-a628-78620b6d1932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.947s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080d289a-ddf5-4cc7-a628-78620b6d1932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1775443283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13695ce6-9330-4267-b275-308915363e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e39bcbb4bd44589aae300565e21d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:04Z,use_quota=True,user_id='613a74d695e34a9786144ebf95365dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05bf85e3-9f82-48a4-bc93-a268dab60732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05bf85e3-9f82-48a4-bc93-a268dab60732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d15d6c4-df00-41de-a682-3944677b870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d15d6c4-df00-41de-a682-3944677b870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13695ce6-9330-4267-b275-308915363e23', 'volume_name': 'volume-13695ce6-9330-4267-b275-308915363e23', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9201e47-3004-4df1-83df-9f197a41b7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9201e47-3004-4df1-83df-9f197a41b7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9893b584-21bc-48bb-a4a2-84cb53b80db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:04 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume 13695ce6-9330-4267-b275-308915363e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13695ce6-9330-4267-b275-308915363e23', 'volume_size': 1}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1775443283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13695ce6-9330-4267-b275-308915363e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e39bcbb4bd44589aae300565e21d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:04Z,use_quota=True,user_id='613a74d695e34a9786144ebf95365dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Creating volume 13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:04 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Deleted volume successfully.
Jun 24 04:28:04 devstack sudo[108676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 1073741824
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ce736173-1541-4159-b4e0-8f60de298283 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-ed7ac5ce-f5e0-460a-b9c5-b7b6e7cdb910-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:04 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:04 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3" returned: 1 in 0.901s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:28:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:04 devstack sudo[108682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3
Jun 24 04:28:04 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:05 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 1073741824" returned: 0 in 0.924s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:05 devstack sudo[108688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23
Jun 24 04:28:05 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Flow 'volume_create_manager' (898c4ff2-2275-4b46-936b-3a5fa3c0283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d52fc15-a7f6-4661-89da-fcfcf11ccb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:05 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d52fc15-a7f6-4661-89da-fcfcf11ccb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1095479147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33d29b7-0735-48f4-a47d-b63f7960109c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1d01c84af4c3fbeb027381da224bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:05Z,use_quota=True,user_id='2e59979229624f35bddd4c2113ee56a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63dd4594-a568-4698-84e9-5cc4ee71d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63dd4594-a568-4698-84e9-5cc4ee71d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5baa8f-1869-4416-9c33-5fff5821c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5baa8f-1869-4416-9c33-5fff5821c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33d29b7-0735-48f4-a47d-b63f7960109c', 'volume_name': 'volume-f33d29b7-0735-48f4-a47d-b63f7960109c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b452e795-bfb5-467a-8f8f-91ea4bb8da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b452e795-bfb5-467a-8f8f-91ea4bb8da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07087ad4-afd3-4066-ab54-c84249d80916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Volume f33d29b7-0735-48f4-a47d-b63f7960109c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33d29b7-0735-48f4-a47d-b63f7960109c', 'volume_size': 1}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0077ca1a-2a69-4225-badc-c7f5c7f542e3" returned: 0 in 0.759s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Lock "cinder-quobyte-0077ca1a-2a69-4225-badc-c7f5c7f542e3" released by "delete_volume" :: held 2.643s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Created reservations ['f30888cf-cdc3-42b4-9018-4a88404961ad', '2aa3fda3-89d5-4640-bef9-420ff952c2c9', '371bc11c-4016-4c79-93ac-d860db03010c', '94efb781-e448-41a9-810b-2b8af42762a3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:05 devstack sudo[108691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:05 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:05 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1095479147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33d29b7-0735-48f4-a47d-b63f7960109c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1d01c84af4c3fbeb027381da224bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:05Z,use_quota=True,user_id='2e59979229624f35bddd4c2113ee56a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Creating volume f33d29b7-0735-48f4-a47d-b63f7960109c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:05 devstack sudo[108694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c 1073741824
Jun 24 04:28:05 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9893b584-21bc-48bb-a4a2-84cb53b80db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13695ce6-9330-4267-b275-308915363e23', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7707deb4-80a1-4337-bf46-3503519da1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Volume volume-13695ce6-9330-4267-b275-308915363e23 (13695ce6-9330-4267-b275-308915363e23): created successfully
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7707deb4-80a1-4337-bf46-3503519da1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (a6944927-1ada-45dd-bb25-ae9c03f2304a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8ac4bd47-1002-419b-8702-44416ef3a668 tempest-VolumesSnapshotTestJSON-1218858181 None] Created volume successfully.
Jun 24 04:28:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:06 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.792s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Deleted volume successfully.
Jun 24 04:28:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a4c6936b-47f2-481b-adff-62d535ca4afe tempest-VolumeImageDependencyTests-55371122 None] Lock "cinder-0077ca1a-2a69-4225-badc-c7f5c7f542e3-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:06 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c 1073741824" returned: 0 in 0.911s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:06 devstack sudo[108701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c
Jun 24 04:28:06 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:07 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c" returned: 0 in 0.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.101s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07087ad4-afd3-4066-ab54-c84249d80916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33d29b7-0735-48f4-a47d-b63f7960109c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459df5df-c14a-4264-a231-c56502364e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Creating offline snapshot f18da073-4892-462a-a861-a31a538a72dc of volume 13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Volume volume-f33d29b7-0735-48f4-a47d-b63f7960109c (f33d29b7-0735-48f4-a47d-b63f7960109c): created successfully
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459df5df-c14a-4264-a231-c56502364e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Flow 'volume_create_manager' (898c4ff2-2275-4b46-936b-3a5fa3c0283b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac6ba5f-582e-492a-9b4c-3a38bb6370f2]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a58693d6-d44c-4be1-90a8-6b1ee9c8d6c2 tempest-VolumesListAdminTestJSON-70342604 None] Created volume successfully.
Jun 24 04:28:07 devstack sudo[108704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23
Jun 24 04:28:07 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:08 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23" returned: 0 in 0.824s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:08 devstack sudo[108709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc 1G
Jun 24 04:28:08 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Flow 'volume_create_manager' (f314d6ff-e6fd-4b1e-a078-16ec05142859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfec867-eccc-4eb0-889e-102558802325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfec867-eccc-4eb0-889e-102558802325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1646271831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7629aae5-0ebd-43d8-a5bb-3f7c87bb737c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1d01c84af4c3fbeb027381da224bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:09Z,use_quota=True,user_id='2e59979229624f35bddd4c2113ee56a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d05b18-2bf2-4bf4-ab14-85e9dc5151fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d05b18-2bf2-4bf4-ab14-85e9dc5151fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626c5941-14ff-490a-b49f-e76443afe179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626c5941-14ff-490a-b49f-e76443afe179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7629aae5-0ebd-43d8-a5bb-3f7c87bb737c', 'volume_name': 'volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66bef46-6cde-417c-9045-86a8f46fe722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66bef46-6cde-417c-9045-86a8f46fe722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a17736-99c0-4eca-be84-d14932cb5bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Volume 7629aae5-0ebd-43d8-a5bb-3f7c87bb737c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c', 'volume_size': 1}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:09 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc 1G" returned: 0 in 0.929s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13695ce6-9330-4267-b275-308915363e23 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:09 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13695ce6-9330-4267-b275-308915363e23 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc
Jun 24 04:28:09 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Flow 'volume_create_manager' (40b4dd00-c54b-40b7-abf5-50bfb6253533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a770d7b-c425-4ad8-82c5-80f72c533b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a770d7b-c425-4ad8-82c5-80f72c533b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc767f5b-b6bb-4b45-9c7a-17fa088f2b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283874f1bc644661846e27f68a9726c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:10Z,use_quota=True,user_id='b149c13fd13d446dab2308b610336cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384df00e-5f76-4f50-a7dd-14f95d860201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384df00e-5f76-4f50-a7dd-14f95d860201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d1173b-1b4a-4342-82aa-6f17a21734ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d1173b-1b4a-4342-82aa-6f17a21734ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc767f5b-b6bb-4b45-9c7a-17fa088f2b31', 'volume_name': 'volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdeae85-4931-437d-875d-06e026ce6804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdeae85-4931-437d-875d-06e026ce6804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a375b9-98ea-4386-90bc-f9553ed5b99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Volume fc767f5b-b6bb-4b45-9c7a-17fa088f2b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31', 'volume_size': 1}
Jun 24 04:28:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:10 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13695ce6-9330-4267-b275-308915363e23 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc" returned: 0 in 0.680s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:10 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc is being set with open permissions: ugo+rw
Jun 24 04:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:10 devstack sudo[108722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc
Jun 24 04:28:10 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:10 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc" returned: 0 in 0.614s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:10 devstack sudo[108725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.info
Jun 24 04:28:10 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:11 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.info" returned: 0 in 0.629s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:11 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.info is being set with open permissions: ugo+rw
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:11 devstack sudo[108728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.info
Jun 24 04:28:11 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:11 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.info" returned: 0 in 0.626s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.417s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.670s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1646271831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7629aae5-0ebd-43d8-a5bb-3f7c87bb737c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1d01c84af4c3fbeb027381da224bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:09Z,use_quota=True,user_id='2e59979229624f35bddd4c2113ee56a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Creating volume 7629aae5-0ebd-43d8-a5bb-3f7c87bb737c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:11 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:11 devstack sudo[108731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c 1073741824
Jun 24 04:28:11 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-26e87e2c-663f-45cb-b139-860f6df478a4 tempest-VolumesSnapshotTestJSON-1218858181 None] Create snapshot completed successfully
Jun 24 04:28:12 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c 1073741824" returned: 0 in 0.820s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:12 devstack sudo[108736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c
Jun 24 04:28:12 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (ffdb156f-f3b9-4e57-90e9-53553f93542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee39b078-1fab-44de-90fe-594f4f338a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee39b078-1fab-44de-90fe-594f4f338a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1130751962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79d240c-fa5e-476a-9ff1-71c539e269f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e39bcbb4bd44589aae300565e21d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f18da073-4892-462a-a861-a31a538a72dc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:13Z,use_quota=True,user_id='613a74d695e34a9786144ebf95365dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d8e8c3-b234-47ba-ba01-d3f71ba4d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d8e8c3-b234-47ba-ba01-d3f71ba4d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d868dc-9c6a-490a-b22c-6fabc6affb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d868dc-9c6a-490a-b22c-6fabc6affb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a79d240c-fa5e-476a-9ff1-71c539e269f1', 'volume_name': 'volume-a79d240c-fa5e-476a-9ff1-71c539e269f1', 'volume_size': 1, 'snapshot_id': 'f18da073-4892-462a-a861-a31a538a72dc'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6edba0-5b95-495b-a00f-75c6f0ae2a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6edba0-5b95-495b-a00f-75c6f0ae2a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65421881-22f6-4b6a-8ab1-3d129ccb624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Volume a79d240c-fa5e-476a-9ff1-71c539e269f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a79d240c-fa5e-476a-9ff1-71c539e269f1', 'volume_size': 1, 'snapshot_id': 'f18da073-4892-462a-a861-a31a538a72dc'}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:13 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c" returned: 0 in 0.641s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.767s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc767f5b-b6bb-4b45-9c7a-17fa088f2b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283874f1bc644661846e27f68a9726c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:10Z,use_quota=True,user_id='b149c13fd13d446dab2308b610336cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Creating volume fc767f5b-b6bb-4b45-9c7a-17fa088f2b31 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:13 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a17736-99c0-4eca-be84-d14932cb5bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack sudo[108739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31 1073741824
Jun 24 04:28:13 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcfe074-4d20-4daa-917c-6173444c26d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:13 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Volume volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c (7629aae5-0ebd-43d8-a5bb-3f7c87bb737c): created successfully
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcfe074-4d20-4daa-917c-6173444c26d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:13 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Flow 'volume_create_manager' (f314d6ff-e6fd-4b1e-a078-16ec05142859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:13 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-fb25b5de-33ec-4a86-92d1-63dd6b503ddd tempest-VolumesListAdminTestJSON-70342604 None] Created volume successfully.
Jun 24 04:28:14 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31 1073741824" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:14 devstack sudo[108745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31
Jun 24 04:28:14 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Flow 'volume_create_manager' (11a1194b-c6a3-4b55-9647-fdab63976005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f586ea-78d6-46b0-9013-6e751bed8de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:14 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31" returned: 0 in 0.680s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.677s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-f18da073-4892-462a-a861-a31a538a72dc-a79d240c-fa5e-476a-9ff1-71c539e269f1" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f586ea-78d6-46b0-9013-6e751bed8de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1453746289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158f0b59-3a5c-4be3-a81d-cadc6e48c379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1d01c84af4c3fbeb027381da224bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:15Z,use_quota=True,user_id='2e59979229624f35bddd4c2113ee56a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b8779a-d2a2-487f-bf24-4e1f44d8d495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b8779a-d2a2-487f-bf24-4e1f44d8d495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ea06fa-8ee1-42b5-a1ef-921c13b744e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ea06fa-8ee1-42b5-a1ef-921c13b744e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158f0b59-3a5c-4be3-a81d-cadc6e48c379', 'volume_name': 'volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c9da03-adc6-441c-8782-a6f15f9c5d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c9da03-adc6-441c-8782-a6f15f9c5d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2088e4-1501-4845-9922-b14ef1e15e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:14 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Volume 158f0b59-3a5c-4be3-a81d-cadc6e48c379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379', 'volume_size': 1}
Jun 24 04:28:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a375b9-98ea-4386-90bc-f9553ed5b99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ea87ef-e931-4079-bffd-522e3e6a6abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-f18da073-4892-462a-a861-a31a538a72dc-a79d240c-fa5e-476a-9ff1-71c539e269f1" acquired by "_create_volume_from_snapshot" :: waited 0.070s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Creating volume a79d240c-fa5e-476a-9ff1-71c539e269f1 from snapshot f18da073-4892-462a-a861-a31a538a72dc {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-a79d240c-fa5e-476a-9ff1-71c539e269f1" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Volume volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31 (fc767f5b-b6bb-4b45-9c7a-17fa088f2b31): created successfully
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ea87ef-e931-4079-bffd-522e3e6a6abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Flow 'volume_create_manager' (40b4dd00-c54b-40b7-abf5-50bfb6253533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-a79d240c-fa5e-476a-9ff1-71c539e269f1" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] snapshot: f18da073-4892-462a-a861-a31a538a72dc, volume: a79d240c-fa5e-476a-9ff1-71c539e269f1,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9ffe3ab0-76ac-4616-abc5-d6a4e2411f1f tempest-CinderUnicodeTest-134744201 None] Created volume successfully.
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8df10b-1b51-4890-91bd-0574a7a939cf]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:15 devstack sudo[108749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc
Jun 24 04:28:15 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:15 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc" returned: 0 in 0.743s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13695ce6-9330-4267-b275-308915363e23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad46158-0177-4573-a20d-b50f42bb0cd8]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:15 devstack sudo[108754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23
Jun 24 04:28:15 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Flow 'volume_create_manager' (a9723e96-6121-45a7-a1cf-b33aac42ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62e8ad6-a0aa-4ccb-a6b0-16966d48a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62e8ad6-a0aa-4ccb-a6b0-16966d48a75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1151845186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216aad27-5949-48db-9669-0870e8c0a1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283874f1bc644661846e27f68a9726c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:16Z,use_quota=True,user_id='b149c13fd13d446dab2308b610336cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadcb6a7-9f42-4be7-ba84-a81fbdfb8e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadcb6a7-9f42-4be7-ba84-a81fbdfb8e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46037434-37d8-424e-a5ba-423510ce0aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46037434-37d8-424e-a5ba-423510ce0aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '216aad27-5949-48db-9669-0870e8c0a1c3', 'volume_name': 'volume-216aad27-5949-48db-9669-0870e8c0a1c3', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f157b6-87dc-48b4-947f-f7473705f958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f157b6-87dc-48b4-947f-f7473705f958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3340892-f54e-4b49-b4b4-ce37396c1a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Volume 216aad27-5949-48db-9669-0870e8c0a1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-216aad27-5949-48db-9669-0870e8c0a1c3', 'volume_size': 1}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:16 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:28:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:16 devstack sudo[108759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1
Jun 24 04:28:16 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:21 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1" returned: 0 in 4.388s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0bf05f-b4de-45d4-af87-468739ef47f1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:21 devstack sudo[108773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23
Jun 24 04:28:21 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:21 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23" returned: 0 in 0.894s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:21 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:28:21 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Converted 1024.00 MB image at 233.27 MB/s
Jun 24 04:28:21 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1 is being set with open permissions: ugo+rw
Jun 24 04:28:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:21 devstack sudo[108778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1
Jun 24 04:28:21 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:22 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1" returned: 0 in 0.628s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-a79d240c-fa5e-476a-9ff1-71c539e269f1" released by "_copy_volume_from_snapshot" :: held 7.527s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-f18da073-4892-462a-a861-a31a538a72dc-a79d240c-fa5e-476a-9ff1-71c539e269f1" released by "_create_volume_from_snapshot" :: held 7.566s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.637s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.588s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1453746289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158f0b59-3a5c-4be3-a81d-cadc6e48c379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1d01c84af4c3fbeb027381da224bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:15Z,use_quota=True,user_id='2e59979229624f35bddd4c2113ee56a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Creating volume 158f0b59-3a5c-4be3-a81d-cadc6e48c379 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:22 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:22 devstack sudo[108781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379 1073741824
Jun 24 04:28:22 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65421881-22f6-4b6a-8ab1-3d129ccb624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79d240c-fa5e-476a-9ff1-71c539e269f1', 'volume_size': 1, 'snapshot_id': 'f18da073-4892-462a-a861-a31a538a72dc'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ae8d84-5dc4-493a-882f-34c94bed43f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:22 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Volume volume-a79d240c-fa5e-476a-9ff1-71c539e269f1 (a79d240c-fa5e-476a-9ff1-71c539e269f1): created successfully
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ae8d84-5dc4-493a-882f-34c94bed43f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Flow 'volume_create_manager' (ffdb156f-f3b9-4e57-90e9-53553f93542d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-83e83b10-878f-41e6-bd7d-3b44c7d3f0df tempest-VolumesSnapshotTestJSON-1218858181 None] Created volume successfully.
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-a79d240c-fa5e-476a-9ff1-71c539e269f1-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-a79d240c-fa5e-476a-9ff1-71c539e269f1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-a79d240c-fa5e-476a-9ff1-71c539e269f1" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-a79d240c-fa5e-476a-9ff1-71c539e269f1" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8a4bef-0a4d-4d8d-8433-d78fac4ef73a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:23 devstack sudo[108783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1
Jun 24 04:28:23 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:23 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379 1073741824" returned: 0 in 0.824s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:23 devstack sudo[108788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379
Jun 24 04:28:23 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:23 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1" returned: 0 in 0.747s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:23 devstack sudo[108793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1
Jun 24 04:28:23 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:24 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379" returned: 0 in 0.649s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.574s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1151845186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216aad27-5949-48db-9669-0870e8c0a1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283874f1bc644661846e27f68a9726c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:16Z,use_quota=True,user_id='b149c13fd13d446dab2308b610336cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Creating volume 216aad27-5949-48db-9669-0870e8c0a1c3 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:24 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:24 devstack sudo[108796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3 1073741824
Jun 24 04:28:24 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2088e4-1501-4845-9922-b14ef1e15e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89efe57-c495-4706-bb6c-f3b4ab5984f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Volume volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379 (158f0b59-3a5c-4be3-a81d-cadc6e48c379): created successfully
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89efe57-c495-4706-bb6c-f3b4ab5984f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Flow 'volume_create_manager' (11a1194b-c6a3-4b55-9647-fdab63976005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:24 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-341594bd-c9a7-4e28-96fb-49b80ca9e458 tempest-VolumesListAdminTestJSON-70342604 None] Created volume successfully.
Jun 24 04:28:24 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a79d240c-fa5e-476a-9ff1-71c539e269f1" returned: 0 in 0.674s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-a79d240c-fa5e-476a-9ff1-71c539e269f1" released by "delete_volume" :: held 1.468s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Created reservations ['d5c9cc96-e79e-4cf8-8856-a3b61b2c4b3c', '467dd074-3ca5-4c8d-84e5-0bf1383726d0', '5907fd1a-98b5-4128-bce6-16ba9b785904', 'fdb60df1-7d4c-4f46-9b16-b96cb07c66a1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:24 devstack sudo[108799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:24 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:25 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3 1073741824" returned: 0 in 0.941s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:25 devstack sudo[108808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3
Jun 24 04:28:25 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-f18da073-4892-462a-a861-a31a538a72dc-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-f18da073-4892-462a-a861-a31a538a72dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-13695ce6-9330-4267-b275-308915363e23" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-13695ce6-9330-4267-b275-308915363e23" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-f18da073-4892-462a-a861-a31a538a72dc" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-f18da073-4892-462a-a861-a31a538a72dc" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Deleting offline snapshot f18da073-4892-462a-a861-a31a538a72dc of volume 13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:28:25 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] snapshot_file for this snap is: volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.771s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Deleted volume successfully.
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0147ae47-28de-415f-bfa7-5fa4a4b5f45e]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b595d429-7a78-428c-aeb7-59d7f79567c3 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-a79d240c-fa5e-476a-9ff1-71c539e269f1-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:25 devstack sudo[108811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc
Jun 24 04:28:25 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Flow 'volume_create_manager' (fbb78076-a388-4516-b2e8-19671700723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bc2dce-09ff-4891-b25d-2d1ce072aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5bc2dce-09ff-4891-b25d-2d1ce072aa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bec09b5-3e47-49c5-a170-e3775b0faa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9b43c77412492f9797d2a977be7fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:26Z,use_quota=True,user_id='5483cde4deac419994dd0583a7ccc60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6919cf15-a657-4aff-ac67-f33659675926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6919cf15-a657-4aff-ac67-f33659675926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fa8bf9-01b1-4a5a-abd4-87f12f1063ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fa8bf9-01b1-4a5a-abd4-87f12f1063ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bec09b5-3e47-49c5-a170-e3775b0faa71', 'volume_name': 'volume-8bec09b5-3e47-49c5-a170-e3775b0faa71', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c52eeea-6bb0-41d4-8b25-4ca6174467d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c52eeea-6bb0-41d4-8b25-4ca6174467d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e36be1-3f1e-4759-a955-c9cd9e0ae422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:25 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Volume 8bec09b5-3e47-49c5-a170-e3775b0faa71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bec09b5-3e47-49c5-a170-e3775b0faa71', 'volume_size': 1}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:25 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3" returned: 0 in 0.834s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.244s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bec09b5-3e47-49c5-a170-e3775b0faa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9b43c77412492f9797d2a977be7fdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:26Z,use_quota=True,user_id='5483cde4deac419994dd0583a7ccc60a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Creating volume 8bec09b5-3e47-49c5-a170-e3775b0faa71 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:25 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3340892-f54e-4b49-b4b4-ce37396c1a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216aad27-5949-48db-9669-0870e8c0a1c3', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:25 devstack sudo[108820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71 1073741824
Jun 24 04:28:25 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d436c12d-c9c5-43c7-aeaa-ef931e000080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Volume volume-216aad27-5949-48db-9669-0870e8c0a1c3 (216aad27-5949-48db-9669-0870e8c0a1c3): created successfully
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d436c12d-c9c5-43c7-aeaa-ef931e000080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Flow 'volume_create_manager' (a9723e96-6121-45a7-a1cf-b33aac42ca16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d2f9164c-4d86-4c59-b4b3-0e15a702edcc tempest-CinderUnicodeTest-134744201 None] Created volume successfully.
Jun 24 04:28:26 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc" returned: 0 in 0.825s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13695ce6-9330-4267-b275-308915363e23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe296ab-e9bc-4558-ba54-8fa5b67e8d55]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:26 devstack sudo[108825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23
Jun 24 04:28:26 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:26 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71 1073741824" returned: 0 in 0.882s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:26 devstack sudo[108830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71
Jun 24 04:28:26 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:27 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23" returned: 0 in 0.805s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:27 devstack sudo[108835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc
Jun 24 04:28:27 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:27 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71" returned: 0 in 0.633s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Creating offline snapshot e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 of volume 216aad27-5949-48db-9669-0870e8c0a1c3 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e36be1-3f1e-4759-a955-c9cd9e0ae422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bec09b5-3e47-49c5-a170-e3775b0faa71', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c315ed-320f-4bb7-b2ab-08eff5d7cf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7649b904-a117-4fa9-a1e6-479347f34dd2]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:27 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Volume volume-8bec09b5-3e47-49c5-a170-e3775b0faa71 (8bec09b5-3e47-49c5-a170-e3775b0faa71): created successfully
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c315ed-320f-4bb7-b2ab-08eff5d7cf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Flow 'volume_create_manager' (fbb78076-a388-4516-b2e8-19671700723f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:27 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7a82893b-d7e3-4df6-8b2c-5cfcb66521f4 tempest-VolumesListAdminTestJSON-723893748 None] Created volume successfully.
Jun 24 04:28:27 devstack sudo[108838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3
Jun 24 04:28:27 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:27 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc" returned: 0 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:27 devstack sudo[108844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc
Jun 24 04:28:27 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:28 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3" returned: 0 in 0.783s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:28 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 1G
Jun 24 04:28:28 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:28 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23.f18da073-4892-462a-a861-a31a538a72dc" returned: 0 in 0.649s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-f18da073-4892-462a-a861-a31a538a72dc" released by "_delete_snapshot" :: held 3.198s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-13695ce6-9330-4267-b275-308915363e23" released by "delete_snapshot" :: held 3.239s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Created reservations ['c75f5540-796b-4bcf-8e00-d1d1846ce9ae', '2c5812d2-3d2c-4ebc-a062-cdcc3a5a59f4', '345d91b2-a5fc-499c-8d59-acbe63ec9e0a', 'cd11bbca-acb4-4e14-a879-1306447943ac'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Delete snapshot completed successfully.
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b018414b-af9f-49c9-b5e7-f2bd5654b5e5 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-f18da073-4892-462a-a861-a31a538a72dc-delete_snapshot" released by "delete_snapshot" :: held 3.385s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Acquiring lock "cinder-8bec09b5-3e47-49c5-a170-e3775b0faa71-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Lock "cinder-8bec09b5-3e47-49c5-a170-e3775b0faa71-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Acquiring lock "cinder-quobyte-8bec09b5-3e47-49c5-a170-e3775b0faa71" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Lock "cinder-quobyte-8bec09b5-3e47-49c5-a170-e3775b0faa71" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fee2bb-b847-4326-9739-e95c96074f15]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "cinder-158f0b59-3a5c-4be3-a81d-cadc6e48c379-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-158f0b59-3a5c-4be3-a81d-cadc6e48c379-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "cinder-quobyte-158f0b59-3a5c-4be3-a81d-cadc6e48c379" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:29 devstack sudo[108855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71
Jun 24 04:28:29 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-quobyte-158f0b59-3a5c-4be3-a81d-cadc6e48c379" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6ba68-8b3d-4a40-bb74-66c8d706c661]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:29 devstack sudo[108858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379
Jun 24 04:28:29 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:29 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 1G" returned: 0 in 0.888s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216aad27-5949-48db-9669-0870e8c0a1c3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:29 devstack sudo[108860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216aad27-5949-48db-9669-0870e8c0a1c3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17
Jun 24 04:28:29 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-13695ce6-9330-4267-b275-308915363e23-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-13695ce6-9330-4267-b275-308915363e23-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-13695ce6-9330-4267-b275-308915363e23" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-13695ce6-9330-4267-b275-308915363e23" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[330af3eb-8a89-40d1-a248-8aa32e0ae0c1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:29 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:29 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71
Jun 24 04:28:29 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:29 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23
Jun 24 04:28:29 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:29 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379" returned: 0 in 0.862s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:30 devstack sudo[108875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379
Jun 24 04:28:30 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:30 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216aad27-5949-48db-9669-0870e8c0a1c3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17" returned: 0 in 0.817s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:30 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 is being set with open permissions: ugo+rw
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:30 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17
Jun 24 04:28:30 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:30 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8bec09b5-3e47-49c5-a170-e3775b0faa71" returned: 0 in 0.703s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Lock "cinder-quobyte-8bec09b5-3e47-49c5-a170-e3775b0faa71" released by "delete_volume" :: held 1.617s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Created reservations ['63f0e18e-2a58-49d1-9388-a3f843b55876', '6f721b39-168e-4bba-89de-512b7c9d3cc6', 'bf0749ef-2896-402e-b4d3-a0305a3a8772', '8bca8ac3-0692-4f6e-8df3-bec9ea7b8e3a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:30 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23" returned: 0 in 0.899s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:30 devstack sudo[108887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23
Jun 24 04:28:30 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:30 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-158f0b59-3a5c-4be3-a81d-cadc6e48c379" returned: 0 in 0.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-quobyte-158f0b59-3a5c-4be3-a81d-cadc6e48c379" released by "delete_volume" :: held 1.646s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:30 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17" returned: 0 in 0.745s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:30 devstack sudo[108889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:30 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Created reservations ['105d036e-a8af-4734-9e80-07454b332c51', 'd1879621-80c8-4e99-a66f-93fc053ca233', '2320428d-07af-4b1e-9c6f-819bf9f88d1d', '5ad5e60e-a9ac-4c07-8361-1f6834e8c7c5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:30 devstack sudo[108891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.info
Jun 24 04:28:30 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:30 devstack sudo[108893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:30 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:31 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-13695ce6-9330-4267-b275-308915363e23" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "cinder-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-13695ce6-9330-4267-b275-308915363e23" released by "delete_volume" :: held 1.772s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "cinder-quobyte-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:31 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Created reservations ['bd5d7e0f-72ab-4ae7-9a26-e688e495c502', '883a5346-1799-40c2-9ba6-74f46be7a56d', '3b87b434-d728-4ae1-a2ba-0b68219eddff', 'd9bf2f21-9cae-4214-88a9-6710faaadb7d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-quobyte-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Deleted volume successfully.
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bc7561-91bf-4b6c-9611-12761e2c8db0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:31 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.info" returned: 0 in 0.787s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:31 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.info is being set with open permissions: ugo+rw
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8d790681-7720-40aa-97ed-7eff1d4040fb tempest-VolumesListAdminTestJSON-723893748 None] Lock "cinder-8bec09b5-3e47-49c5-a170-e3775b0faa71-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:31 devstack sudo[108899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.info
Jun 24 04:28:31 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:31 devstack sudo[108902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:31 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:31 devstack sudo[108898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c
Jun 24 04:28:31 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:31 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.901s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Deleted volume successfully.
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-098345f4-9376-429c-a666-6cf4b2c1dd2d tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-158f0b59-3a5c-4be3-a81d-cadc6e48c379-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "cinder-quobyte-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a90a5c6-c837-4475-9591-e26652766958]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:32 devstack sudo[108905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7
Jun 24 04:28:32 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:32 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.info" returned: 0 in 0.837s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.977s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-91e138d7-a158-4df8-9d6d-43852e5d108a tempest-CinderUnicodeTest-134744201 None] Create snapshot completed successfully
Jun 24 04:28:32 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c" returned: 0 in 0.928s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:32 devstack sudo[108913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c
Jun 24 04:28:32 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:32 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.892s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Deleted volume successfully.
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cf043730-2310-40a8-ba08-292aa7ae4573 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-13695ce6-9330-4267-b275-308915363e23-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Acquiring lock "cinder-e039d5cc-452d-4c50-b3d8-b6ef8cb16f17-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-e039d5cc-452d-4c50-b3d8-b6ef8cb16f17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Acquiring lock "cinder-quobyte-216aad27-5949-48db-9669-0870e8c0a1c3" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-quobyte-216aad27-5949-48db-9669-0870e8c0a1c3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Acquiring lock "cinder-quobyte-e039d5cc-452d-4c50-b3d8-b6ef8cb16f17" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-quobyte-e039d5cc-452d-4c50-b3d8-b6ef8cb16f17" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Deleting offline snapshot e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 of volume 216aad27-5949-48db-9669-0870e8c0a1c3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] snapshot_file for this snap is: volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afaddcf-b2fd-4691-9074-7850963cf6ea]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:32 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" returned: 0 in 0.857s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:33 devstack sudo[108921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7
Jun 24 04:28:33 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:33 devstack sudo[108920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17
Jun 24 04:28:33 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:33 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c" returned: 0 in 0.717s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-quobyte-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c" released by "delete_volume" :: held 1.712s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Created reservations ['3cf46ad2-d7b9-4634-9f3e-8fe7fbaeb3a5', 'a998cbfe-5d8d-4bcf-9027-7e8a6b349b9e', '8f7753d0-85ab-4385-917d-a54d4477f2f1', '1adbefc6-257b-478f-b6a0-b2048b667c35'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:33 devstack sudo[108925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:33 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:33 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" returned: 0 in 0.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-quobyte-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7" released by "delete_volume" :: held 1.622s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Created reservations ['00403c31-7195-4bdc-a33c-55e745c62a82', '20ca142d-8fe1-4cec-ab88-5a1810286a97', '3793645e-07a8-42b3-89c3-607a59ba0327', '6bcfdc1b-22a3-4c2d-92c8-a830982d93c5'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:33 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-216aad27-5949-48db-9669-0870e8c0a1c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "cinder-f33d29b7-0735-48f4-a47d-b63f7960109c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea72be12-dc74-479d-af19-b3df356180d7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-f33d29b7-0735-48f4-a47d-b63f7960109c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:33 devstack sudo[108931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3
Jun 24 04:28:33 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "cinder-quobyte-f33d29b7-0735-48f4-a47d-b63f7960109c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-quobyte-f33d29b7-0735-48f4-a47d-b63f7960109c" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c75f5dd-9b2f-4a19-a75b-7f072587bc6b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:34 devstack sudo[108933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:34 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:34 devstack sudo[108935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c
Jun 24 04:28:34 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:34 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.744s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Deleted volume successfully.
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-283a585f-06b4-4705-85a7-a93020d80531 tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-7629aae5-0ebd-43d8-a5bb-3f7c87bb737c-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:34 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3" returned: 0 in 0.788s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:34 devstack sudo[108942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17
Jun 24 04:28:34 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:34 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.776s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Deleted volume successfully.
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9dc692a-71cd-4f50-bedf-c82e630cbf42 tempest-VolumesSnapshotTestJSON-1218858181 None] Lock "cinder-9cb02a9c-2b17-49b7-8b54-5a04d712a4e7-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:34 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c" returned: 0 in 0.867s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:34 devstack sudo[108950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c
Jun 24 04:28:34 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:35 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17" returned: 0 in 0.837s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:35 devstack sudo[108955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17
Jun 24 04:28:35 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:35 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-f33d29b7-0735-48f4-a47d-b63f7960109c" returned: 0 in 0.689s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-quobyte-f33d29b7-0735-48f4-a47d-b63f7960109c" released by "delete_volume" :: held 1.608s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Created reservations ['7cae72d7-d4ec-499d-9293-aa547965e713', '18ca7a27-4daa-44f7-b165-65b26f58a49b', 'e1d4609c-8363-48a1-aca7-c95458018288', 'b81b1bb5-a765-4045-ac7b-e6f443ed5fd1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:35 devstack sudo[108959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:35 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:36 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3.e039d5cc-452d-4c50-b3d8-b6ef8cb16f17" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-quobyte-e039d5cc-452d-4c50-b3d8-b6ef8cb16f17" released by "_delete_snapshot" :: held 3.396s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-quobyte-216aad27-5949-48db-9669-0870e8c0a1c3" released by "delete_snapshot" :: held 3.426s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Created reservations ['beaca188-b343-40f4-8a9a-c7af98bdf7e7', 'f6aa74b2-dd13-4809-bec1-c77c7e1ce2ef', '8d893cf7-ab0f-4429-9417-41b8068834ba', 'badeb447-6831-47dc-b43f-e9203d4390b3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Delete snapshot completed successfully.
Jun 24 04:28:36 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-75f2d2cc-9536-4db1-833a-c34d063c9b52 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-e039d5cc-452d-4c50-b3d8-b6ef8cb16f17-delete_snapshot" released by "delete_snapshot" :: held 3.637s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.822s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:36 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Deleted volume successfully.
Jun 24 04:28:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d7e7806-778b-43b0-820d-3ea154e7ad5b tempest-VolumesListAdminTestJSON-70342604 None] Lock "cinder-f33d29b7-0735-48f4-a47d-b63f7960109c-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Acquiring lock "cinder-216aad27-5949-48db-9669-0870e8c0a1c3-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-216aad27-5949-48db-9669-0870e8c0a1c3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Acquiring lock "cinder-quobyte-216aad27-5949-48db-9669-0870e8c0a1c3" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-quobyte-216aad27-5949-48db-9669-0870e8c0a1c3" acquired by "delete_volume" :: waited 0.053s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[54242c4a-e97d-4456-a69e-83c3f8585c99]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:37 devstack sudo[108964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3
Jun 24 04:28:37 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:38 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3" returned: 0 in 0.928s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:38 devstack sudo[108971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3
Jun 24 04:28:38 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:39 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-216aad27-5949-48db-9669-0870e8c0a1c3" returned: 0 in 0.811s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-quobyte-216aad27-5949-48db-9669-0870e8c0a1c3" released by "delete_volume" :: held 1.840s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Created reservations ['9c3db22e-6b07-4fc6-9bfd-31ac1d85cc91', '5c7bbea8-3526-433e-b7f2-2b166b598c91', 'ad4c3370-2fe1-470b-ad6e-0bf5d14570de', 'b579ce1e-6e9a-4c74-bf76-f7cf57fb609d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:39 devstack sudo[108974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:39 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Acquiring lock "cinder-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Lock "cinder-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Acquiring lock "cinder-quobyte-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Lock "cinder-quobyte-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ecbee-3db2-4d2a-8005-d049b7704ac1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:39 devstack sudo[108976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31
Jun 24 04:28:39 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:40 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.763s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:40 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:40 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Deleted volume successfully.
Jun 24 04:28:40 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6bae0de-b8b4-441f-b2e8-176973f32739 tempest-CinderUnicodeTest-134744201 None] Lock "cinder-216aad27-5949-48db-9669-0870e8c0a1c3-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:40 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31" returned: 0 in 0.873s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:40 devstack sudo[108983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31
Jun 24 04:28:40 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Flow 'volume_create_manager' (f05cf3c4-0e5c-4a2a-8bab-8a559086cab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c750a52d-cfab-4ab6-8f52-2062cdd241b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31" returned: 0 in 0.740s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c750a52d-cfab-4ab6-8f52-2062cdd241b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1621310204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1692be05-739a-4fdf-96a6-694285fa7fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9573fac7198846678c4250902ca75b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:41Z,use_quota=True,user_id='1e3b1338aad14913af57aa3e33cddcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62168f06-a51c-4a19-b421-b60405d6446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62168f06-a51c-4a19-b421-b60405d6446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c350ae-a920-47cd-820d-48342297d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c350ae-a920-47cd-820d-48342297d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1692be05-739a-4fdf-96a6-694285fa7fb4', 'volume_name': 'volume-1692be05-739a-4fdf-96a6-694285fa7fb4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb22b514-eae9-4526-9172-9b0eabd32e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb22b514-eae9-4526-9172-9b0eabd32e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad82d18e-9f02-4171-aca5-cfee5ce6cfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Volume 1692be05-739a-4fdf-96a6-694285fa7fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1692be05-739a-4fdf-96a6-694285fa7fb4', 'volume_size': 1}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1621310204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1692be05-739a-4fdf-96a6-694285fa7fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9573fac7198846678c4250902ca75b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:41Z,use_quota=True,user_id='1e3b1338aad14913af57aa3e33cddcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Creating volume 1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:41 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Lock "cinder-quobyte-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31" released by "delete_volume" :: held 1.733s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:41 devstack sudo[108986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4 1073741824
Jun 24 04:28:41 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Created reservations ['80e0be7f-7126-40b2-a1ec-d3a09f17495d', 'cbf69ba2-d57b-4156-8f69-bb4a8bb1009c', '7550efa0-ecce-4563-8c9e-dc18fa68c4a7', '054287f4-58c5-4842-808e-6d476028d293'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Flow 'volume_create_manager' (3c8e506c-9cb7-45ce-b3cf-8c57a2926b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e13cc18-849e-4da6-b618-34cef7c21652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e13cc18-849e-4da6-b618-34cef7c21652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1848055264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f3e0e7-bd28-4351-8257-af0f499c2819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004019abacc14094bc40e1c3ff9ccfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:41Z,use_quota=True,user_id='c0cc7621f46646c2b34cae9b04bc0d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c482f46-6e1f-48c9-b6b0-90b9a4026040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c482f46-6e1f-48c9-b6b0-90b9a4026040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6443a1-65ea-41a0-85e9-44adb9fbee46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6443a1-65ea-41a0-85e9-44adb9fbee46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f3e0e7-bd28-4351-8257-af0f499c2819', 'volume_name': 'volume-96f3e0e7-bd28-4351-8257-af0f499c2819', 'volume_size': 2}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c2fa68-4768-485d-8426-032d533fc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c2fa68-4768-485d-8426-032d533fc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8c5ee8-9b70-43d0-ba25-921b872ce33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Volume 96f3e0e7-bd28-4351-8257-af0f499c2819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f3e0e7-bd28-4351-8257-af0f499c2819', 'volume_size': 2}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:41 devstack sudo[108988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:28:41 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:42 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4 1073741824" returned: 0 in 0.897s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:42 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.701s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:28:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Deleted volume successfully.
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dfbf7287-8505-448c-ab21-0531c1c37aeb tempest-CinderUnicodeTest-134744201 None] Lock "cinder-fc767f5b-b6bb-4b45-9c7a-17fa088f2b31-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:42 devstack sudo[108995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4
Jun 24 04:28:42 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:42 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4" returned: 0 in 0.658s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.442s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1848055264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f3e0e7-bd28-4351-8257-af0f499c2819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='004019abacc14094bc40e1c3ff9ccfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:28:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:28:41Z,use_quota=True,user_id='c0cc7621f46646c2b34cae9b04bc0d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Creating volume 96f3e0e7-bd28-4351-8257-af0f499c2819 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:28:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819 2147483648 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:42 devstack sudo[108998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819 2147483648
Jun 24 04:28:42 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad82d18e-9f02-4171-aca5-cfee5ce6cfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1692be05-739a-4fdf-96a6-694285fa7fb4', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67fdc2a-1f32-4b40-ba73-0cc81a07d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Volume volume-1692be05-739a-4fdf-96a6-694285fa7fb4 (1692be05-739a-4fdf-96a6-694285fa7fb4): created successfully
Jun 24 04:28:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67fdc2a-1f32-4b40-ba73-0cc81a07d54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Flow 'volume_create_manager' (f05cf3c4-0e5c-4a2a-8bab-8a559086cab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a3001b4a-a566-430a-a624-a5ff44a3fbd0 tempest-VolumesDeleteCascade-523317533 None] Created volume successfully.
Jun 24 04:28:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:43 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819 2147483648" returned: 0 in 0.932s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:43 devstack sudo[109004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819
Jun 24 04:28:43 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:44 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819" returned: 0 in 0.676s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.168s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8c5ee8-9b70-43d0-ba25-921b872ce33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f3e0e7-bd28-4351-8257-af0f499c2819', 'volume_size': 2}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5933661e-4997-40f0-880a-259efa4e406e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Creating offline snapshot fdd8cc25-6b69-4753-836f-cb6d161a484f of volume 1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[168fb367-e907-49a8-956a-e5cd46f29287]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Volume volume-96f3e0e7-bd28-4351-8257-af0f499c2819 (96f3e0e7-bd28-4351-8257-af0f499c2819): created successfully
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5933661e-4997-40f0-880a-259efa4e406e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:28:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Flow 'volume_create_manager' (3c8e506c-9cb7-45ce-b3cf-8c57a2926b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:28:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e87cc715-e74c-4fe7-a374-38f345a294d9 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Created volume successfully.
Jun 24 04:28:44 devstack sudo[109007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4
Jun 24 04:28:44 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:45 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4" returned: 0 in 0.829s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:45 devstack sudo[109013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f 1G
Jun 24 04:28:45 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:46 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f 1G" returned: 0 in 0.848s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1692be05-739a-4fdf-96a6-694285fa7fb4 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:46 devstack sudo[109018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1692be05-739a-4fdf-96a6-694285fa7fb4 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f
Jun 24 04:28:46 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:47 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1692be05-739a-4fdf-96a6-694285fa7fb4 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f" returned: 0 in 0.716s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:47 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f is being set with open permissions: ugo+rw
Jun 24 04:28:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:47 devstack sudo[109023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f
Jun 24 04:28:47 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:47 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f" returned: 0 in 0.631s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:47 devstack sudo[109026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.info
Jun 24 04:28:47 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:48 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.info" returned: 0 in 0.699s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:48 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.info is being set with open permissions: ugo+rw
Jun 24 04:28:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:48 devstack sudo[109029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.info
Jun 24 04:28:48 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:49 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.info" returned: 0 in 0.907s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.742s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.571s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Creating offline snapshot 0711cb02-d37e-4a0d-90ee-1416f887feb3 of volume 96f3e0e7-bd28-4351-8257-af0f499c2819 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:49 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c667c-d87f-4947-9cc4-fdef73be381a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d96406bb-1cd9-4ffa-90e6-8a4cdcea0140 tempest-VolumesDeleteCascade-523317533 None] Create snapshot completed successfully
Jun 24 04:28:49 devstack sudo[109068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819
Jun 24 04:28:49 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:28:50 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819" returned: 0 in 0.827s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 2G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:50 devstack sudo[109073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 2G
Jun 24 04:28:50 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:51 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 2G" returned: 0 in 0.866s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f3e0e7-bd28-4351-8257-af0f499c2819 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:51 devstack sudo[109079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f3e0e7-bd28-4351-8257-af0f499c2819 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3
Jun 24 04:28:51 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:51 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f3e0e7-bd28-4351-8257-af0f499c2819 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:51 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 is being set with open permissions: ugo+rw
Jun 24 04:28:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:51 devstack sudo[109085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3
Jun 24 04:28:51 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:52 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3" returned: 0 in 0.650s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:52 devstack sudo[109088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.info
Jun 24 04:28:52 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.info" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:53 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.info is being set with open permissions: ugo+rw
Jun 24 04:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:53 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:53 devstack sudo[109091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.info
Jun 24 04:28:53 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:53 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.info" returned: 0 in 0.632s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.515s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.911s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:28:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Creating offline snapshot 3ba3975d-d97e-45ac-a8c7-3857ae4ba978 of volume 1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:28:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b2621949-07fe-4d90-aac3-86307507893d tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Create snapshot completed successfully
Jun 24 04:28:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb7289a-d984-4715-9939-9dce32477e18]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:54 devstack sudo[109094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f
Jun 24 04:28:54 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "cinder-0711cb02-d37e-4a0d-90ee-1416f887feb3-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-0711cb02-d37e-4a0d-90ee-1416f887feb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "cinder-quobyte-96f3e0e7-bd28-4351-8257-af0f499c2819" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-quobyte-96f3e0e7-bd28-4351-8257-af0f499c2819" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "cinder-quobyte-0711cb02-d37e-4a0d-90ee-1416f887feb3" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-quobyte-0711cb02-d37e-4a0d-90ee-1416f887feb3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Deleting offline snapshot 0711cb02-d37e-4a0d-90ee-1416f887feb3 of volume 96f3e0e7-bd28-4351-8257-af0f499c2819 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] snapshot_file for this snap is: volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e003e8-4326-40be-aec1-c58159e3b3bc]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:54 devstack sudo[109096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3
Jun 24 04:28:54 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:54 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f" returned: 0 in 0.943s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1692be05-739a-4fdf-96a6-694285fa7fb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:54 devstack sudo[109103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 1G
Jun 24 04:28:54 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:55 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3" returned: 0 in 0.874s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f3e0e7-bd28-4351-8257-af0f499c2819(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7645a10-ce63-4100-965f-98b1658e9ff1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:55 devstack sudo[109109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819
Jun 24 04:28:55 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:55 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 1G" returned: 0 in 0.916s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:55 devstack sudo[109116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978
Jun 24 04:28:55 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:56 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819" returned: 0 in 0.974s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:56 devstack sudo[109121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3
Jun 24 04:28:56 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:56 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978" returned: 0 in 0.714s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:56 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 is being set with open permissions: ugo+rw
Jun 24 04:28:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:56 devstack sudo[109127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978
Jun 24 04:28:56 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:57 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3" returned: 0 in 0.887s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:57 devstack sudo[109134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3
Jun 24 04:28:57 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:57 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978" returned: 0 in 0.760s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.471s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:28:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3b32fda8-9c93-4bc6-9927-9b4d5338b464 tempest-VolumesDeleteCascade-523317533 None] Create snapshot completed successfully
Jun 24 04:28:57 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819.0711cb02-d37e-4a0d-90ee-1416f887feb3" returned: 0 in 0.730s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-quobyte-0711cb02-d37e-4a0d-90ee-1416f887feb3" released by "_delete_snapshot" :: held 3.579s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-quobyte-96f3e0e7-bd28-4351-8257-af0f499c2819" released by "delete_snapshot" :: held 3.607s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Created reservations ['16832695-8a15-45ac-96af-928bc3cec616', 'f8992fb4-c861-4608-98ab-b97c52cd1cac', '3ca7313f-dc8e-4cd9-a215-bc86e78c825e', '1497e88a-3fb5-43f4-99a6-440f7d68becb'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:28:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Delete snapshot completed successfully.
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5129f8e9-9de2-42b8-ac4d-0c2503e504fa tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-0711cb02-d37e-4a0d-90ee-1416f887feb3-delete_snapshot" released by "delete_snapshot" :: held 3.801s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-1692be05-739a-4fdf-96a6-694285fa7fb4-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-1692be05-739a-4fdf-96a6-694285fa7fb4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Performing cascade delete. {{(pid=93468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-3ba3975d-d97e-45ac-a8c7-3857ae4ba978-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-3ba3975d-d97e-45ac-a8c7-3857ae4ba978-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-3ba3975d-d97e-45ac-a8c7-3857ae4ba978" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-3ba3975d-d97e-45ac-a8c7-3857ae4ba978" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Deleting offline snapshot 3ba3975d-d97e-45ac-a8c7-3857ae4ba978 of volume 1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] snapshot_file for this snap is: volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4403c9-cbc1-45a3-8e46-73635b5e66b7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:58 devstack sudo[109137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978
Jun 24 04:28:58 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "cinder-96f3e0e7-bd28-4351-8257-af0f499c2819-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-96f3e0e7-bd28-4351-8257-af0f499c2819-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "cinder-quobyte-96f3e0e7-bd28-4351-8257-af0f499c2819" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-quobyte-96f3e0e7-bd28-4351-8257-af0f499c2819" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c1c84-b092-4ce0-8081-db7e983ef6b2]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:58 devstack sudo[109139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819
Jun 24 04:28:58 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:59 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1692be05-739a-4fdf-96a6-694285fa7fb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:28:59 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dff07ef-cfcc-46c7-bd55-16580e1d8f55]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:28:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:59 devstack sudo[109146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f
Jun 24 04:28:59 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:28:59 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root
Jun 24 04:28:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819" returned: 0 in 0.856s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:28:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:28:59 devstack sudo[109151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819
Jun 24 04:28:59 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:00 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f" returned: 0 in 1.025s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1692be05-739a-4fdf-96a6-694285fa7fb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:00 devstack sudo[109156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978
Jun 24 04:29:00 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:00 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-96f3e0e7-bd28-4351-8257-af0f499c2819" returned: 0 in 0.926s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-quobyte-96f3e0e7-bd28-4351-8257-af0f499c2819" released by "delete_volume" :: held 1.887s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=124,cinder:UPDATE=159,cinder:INSERT=36,cinder:DELETE=6 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=119,cinder:INSERT=45,cinder:UPDATE=139,cinder:DELETE=21 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Created reservations ['9079dfc2-60dd-476a-a694-fdf8acd311bc', '24acdfdf-0d16-4663-9cd9-3e75b96aa57f', '17f9e82e-fb11-4e58-9c9d-980ce795d2bd', '7e401bd0-be99-4f45-8641-78439f35a983'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:01 devstack sudo[109159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:29:01 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:01 devstack sudo[109166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:29:01 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:01 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978" returned: 0 in 1.491s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:01 devstack sudo[109168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978
Jun 24 04:29:01 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:01 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.958s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:01 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Deleted volume successfully.
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-df69802d-6f55-4e8e-bba6-d1f6dfb69ae5 tempest-VolumesSnapshotNegativeTestJSON-1530641416 None] Lock "cinder-96f3e0e7-bd28-4351-8257-af0f499c2819-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:02 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.3ba3975d-d97e-45ac-a8c7-3857ae4ba978" returned: 0 in 0.975s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:02 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-3ba3975d-d97e-45ac-a8c7-3857ae4ba978" released by "_delete_snapshot" :: held 4.457s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.088s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" released by "delete_snapshot" :: held 4.485s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:29:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Created reservations ['7bec243c-56c6-4e77-aa57-69ae1245d827', '0b51da3c-11be-4866-a556-3381002bbf41', 'c4919529-99ae-4e85-95fa-1f9ea3cd9b1d', '36edd1b9-059f-4489-8c83-6ba9cfebff94'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Delete snapshot completed successfully.
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-3ba3975d-d97e-45ac-a8c7-3857ae4ba978-delete_snapshot" released by "delete_snapshot" :: held 4.677s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-fdd8cc25-6b69-4753-836f-cb6d161a484f-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-fdd8cc25-6b69-4753-836f-cb6d161a484f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-fdd8cc25-6b69-4753-836f-cb6d161a484f" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-fdd8cc25-6b69-4753-836f-cb6d161a484f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Deleting offline snapshot fdd8cc25-6b69-4753-836f-cb6d161a484f of volume 1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] snapshot_file for this snap is: volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7ac407-14da-46bb-bdf3-4073818f6482]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:03 devstack sudo[109172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f
Jun 24 04:29:03 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:04 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f" returned: 0 in 0.908s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1692be05-739a-4fdf-96a6-694285fa7fb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:04 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98f3f7c-628d-422d-84c6-6969b3e278a1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:04 devstack sudo[109177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4
Jun 24 04:29:04 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:05 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4" returned: 0 in 0.881s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:05 devstack sudo[109184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f
Jun 24 04:29:05 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:05 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f" returned: 0 in 0.907s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:05 devstack sudo[109190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f
Jun 24 04:29:05 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:06 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4.fdd8cc25-6b69-4753-836f-cb6d161a484f" returned: 0 in 0.686s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-fdd8cc25-6b69-4753-836f-cb6d161a484f" released by "_delete_snapshot" :: held 3.519s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" released by "delete_snapshot" :: held 3.544s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Created reservations ['2ba5a5a3-4825-446e-8cce-6477b4f9098d', '17dfceb8-e614-4bc3-8a12-8fac15102f63', 'd696eb19-c628-4454-a422-2ee9874e095d', '7e347766-5070-495e-9c15-51f90ade8eee'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Delete snapshot completed successfully.
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-fdd8cc25-6b69-4753-836f-cb6d161a484f-delete_snapshot" released by "delete_snapshot" :: held 3.779s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Snapshots deleted, issuing volume delete {{(pid=93468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Flow 'volume_create_manager' (f81af377-9663-49ee-9970-01d8805b7373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc6fe9b-d22e-4c5e-aa28-7ce1e3e36a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" acquired by "delete_volume" :: waited 0.048s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc6fe9b-d22e-4c5e-aa28-7ce1e3e36a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-684526048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0a7140-81d7-4979-844c-1cc547cf9ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd2f8f4d64d4247bbbf89abaf11ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:07Z,use_quota=True,user_id='87b8a39d488e4a81ae8a31495cd1abdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc758227-d17a-4cf9-9f28-83a7ed6c1b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc758227-d17a-4cf9-9f28-83a7ed6c1b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5503b641-03f6-46a2-8510-41bff06e6ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5503b641-03f6-46a2-8510-41bff06e6ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0a7140-81d7-4979-844c-1cc547cf9ee9', 'volume_name': 'volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785c5ff5-81ca-42e3-8eaf-8dd688959bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785c5ff5-81ca-42e3-8eaf-8dd688959bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413c6b49-49aa-45a6-bc42-ee153c2dd9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Volume 3d0a7140-81d7-4979-844c-1cc547cf9ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9', 'volume_size': 1}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-684526048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0a7140-81d7-4979-844c-1cc547cf9ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd2f8f4d64d4247bbbf89abaf11ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:07Z,use_quota=True,user_id='87b8a39d488e4a81ae8a31495cd1abdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Creating volume 3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b537d7b-ae4c-4bd2-a540-36cc07227fcf]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:07 devstack sudo[109193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 1073741824
Jun 24 04:29:07 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:07 devstack sudo[109194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4
Jun 24 04:29:07 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:07 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4" returned: 0 in 0.895s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:07 devstack sudo[109204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4
Jun 24 04:29:07 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:07 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 1073741824" returned: 0 in 0.983s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:08 devstack sudo[109206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9
Jun 24 04:29:08 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:08 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-1692be05-739a-4fdf-96a6-694285fa7fb4" returned: 0 in 0.710s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-1692be05-739a-4fdf-96a6-694285fa7fb4" released by "delete_volume" :: held 1.718s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Created reservations ['cf7b5df5-578c-4d0b-aa98-b6af99ec8ae8', 'd4d31168-1f08-44be-9974-86b88ad448e3', '2554e180-5cd1-4382-8657-8c82710bac38', '9580ed1e-0bc9-46e8-b168-4e220535f442'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:08 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9" returned: 0 in 0.716s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413c6b49-49aa-45a6-bc42-ee153c2dd9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5073ae71-8bee-4249-93b9-f49a4405697f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:08 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Volume volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 (3d0a7140-81d7-4979-844c-1cc547cf9ee9): created successfully
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5073ae71-8bee-4249-93b9-f49a4405697f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Flow 'volume_create_manager' (f81af377-9663-49ee-9970-01d8805b7373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e035fc35-4084-4700-8edf-0beffa8a9a54 tempest-SnapshotDependencyTests-647435203 None] Created volume successfully.
Jun 24 04:29:08 devstack sudo[109210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:29:08 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Creating offline snapshot 7bba6475-8325-4496-a99c-16820289c545 of volume 3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:29:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac12b3d-8f21-437d-9bea-0df8e0cfdcb3]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:09 devstack sudo[109212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9
Jun 24 04:29:09 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:09 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:09 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:09 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Deleted volume successfully.
Jun 24 04:29:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f6ff85bf-c9d0-4469-8056-408be6d45372 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-1692be05-739a-4fdf-96a6-694285fa7fb4-delete_volume" released by "delete_volume" :: held 11.388s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Flow 'volume_create_manager' (de603985-49eb-47a4-ab22-ad7a63b0e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0679fa3-a4a5-44f1-80f8-81ef29d6e9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0679fa3-a4a5-44f1-80f8-81ef29d6e9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-876320229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9574b29-d0bd-489d-b1dc-10fcbfb43781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9573fac7198846678c4250902ca75b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:10Z,use_quota=True,user_id='1e3b1338aad14913af57aa3e33cddcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9051336-0682-4b76-b800-8b4647d16c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9051336-0682-4b76-b800-8b4647d16c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81780ac-a0ae-48b8-8f59-88808b66f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81780ac-a0ae-48b8-8f59-88808b66f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9574b29-d0bd-489d-b1dc-10fcbfb43781', 'volume_name': 'volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4bd227-d061-4281-b602-7c0be03366cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4bd227-d061-4281-b602-7c0be03366cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa31e8d-eb50-457c-a231-c74d306d3c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:10 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Volume a9574b29-d0bd-489d-b1dc-10fcbfb43781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781', 'volume_size': 1}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:10 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9" returned: 0 in 1.013s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:10 devstack sudo[109218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 1G
Jun 24 04:29:10 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:11 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 1G" returned: 0 in 0.929s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:11 devstack sudo[109225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545
Jun 24 04:29:11 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:12 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545" returned: 0 in 0.806s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:12 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 is being set with open permissions: ugo+rw
Jun 24 04:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:12 devstack sudo[109230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545
Jun 24 04:29:12 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:12 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:12 devstack sudo[109233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.info
Jun 24 04:29:12 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.info" returned: 0 in 0.728s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:13 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:13 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.info is being set with open permissions: ugo+rw
Jun 24 04:29:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:13 devstack sudo[109236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.info
Jun 24 04:29:13 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:14 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.info" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.053s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.110s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-876320229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9574b29-d0bd-489d-b1dc-10fcbfb43781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9573fac7198846678c4250902ca75b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:10Z,use_quota=True,user_id='1e3b1338aad14913af57aa3e33cddcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Creating volume a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:14 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:29:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:14 devstack sudo[109239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 1073741824
Jun 24 04:29:14 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-76941acb-9e3d-47fe-85d1-dcf3e58ce88b tempest-SnapshotDependencyTests-647435203 None] Create snapshot completed successfully
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Flow 'volume_create_manager' (a6d1def7-78af-40bd-8e00-f99464183c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa07a5a-ef8e-408e-afdf-4b1d5fbf2ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa07a5a-ef8e-408e-afdf-4b1d5fbf2ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e16bec-346b-4002-861f-39aa66d05715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd2f8f4d64d4247bbbf89abaf11ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7bba6475-8325-4496-a99c-16820289c545,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:15Z,use_quota=True,user_id='87b8a39d488e4a81ae8a31495cd1abdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e0b111-07e2-41da-bf52-a1cc4552e3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e0b111-07e2-41da-bf52-a1cc4552e3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576f65c9-4adf-4936-a252-075b522c845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576f65c9-4adf-4936-a252-075b522c845d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45e16bec-346b-4002-861f-39aa66d05715', 'volume_name': 'volume-45e16bec-346b-4002-861f-39aa66d05715', 'volume_size': 1, 'snapshot_id': '7bba6475-8325-4496-a99c-16820289c545'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e262b7f1-d0ed-42a6-87c7-0da7edcacf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e262b7f1-d0ed-42a6-87c7-0da7edcacf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc218d9-808e-4936-9611-04f41f51a5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Volume 45e16bec-346b-4002-861f-39aa66d05715: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45e16bec-346b-4002-861f-39aa66d05715', 'volume_size': 1, 'snapshot_id': '7bba6475-8325-4496-a99c-16820289c545'}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:15 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 1073741824" returned: 0 in 0.988s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:15 devstack sudo[109246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781
Jun 24 04:29:15 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:16 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781" returned: 0 in 0.671s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.731s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-quobyte-7bba6475-8325-4496-a99c-16820289c545-45e16bec-346b-4002-861f-39aa66d05715" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa31e8d-eb50-457c-a231-c74d306d3c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab958028-de38-4d13-bd15-5bb429a171b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-7bba6475-8325-4496-a99c-16820289c545-45e16bec-346b-4002-861f-39aa66d05715" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Creating volume 45e16bec-346b-4002-861f-39aa66d05715 from snapshot 7bba6475-8325-4496-a99c-16820289c545 {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-quobyte-45e16bec-346b-4002-861f-39aa66d05715" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:16 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Volume volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 (a9574b29-d0bd-489d-b1dc-10fcbfb43781): created successfully
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab958028-de38-4d13-bd15-5bb429a171b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Flow 'volume_create_manager' (de603985-49eb-47a4-ab22-ad7a63b0e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-45e16bec-346b-4002-861f-39aa66d05715" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] snapshot: 7bba6475-8325-4496-a99c-16820289c545, volume: 45e16bec-346b-4002-861f-39aa66d05715,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:29:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7ed914dd-5dc8-489e-b24f-90274ea7b41d tempest-VolumesDeleteCascade-523317533 None] Created volume successfully.
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab621f28-7136-4b54-bb3d-1a10a4f622a6]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:16 devstack sudo[109249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545
Jun 24 04:29:16 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:17 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545" returned: 0 in 0.857s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01962c3-2325-4b39-b882-3e612a8fd7c9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:17 devstack sudo[109254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9
Jun 24 04:29:17 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:17 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9" returned: 0 in 0.782s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:29:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:17 devstack sudo[109259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715
Jun 24 04:29:17 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:23 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715" returned: 0 in 5.633s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260a4f4-108f-42d2-b614-024e39a74df5]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:23 devstack sudo[109272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9
Jun 24 04:29:23 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:24 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9" returned: 0 in 0.978s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:24 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:29:24 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Converted 1024.00 MB image at 181.73 MB/s
Jun 24 04:29:24 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715 is being set with open permissions: ugo+rw
Jun 24 04:29:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:24 devstack sudo[109277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715
Jun 24 04:29:24 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:25 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715" returned: 0 in 0.735s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-45e16bec-346b-4002-861f-39aa66d05715" released by "_copy_volume_from_snapshot" :: held 9.106s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-7bba6475-8325-4496-a99c-16820289c545-45e16bec-346b-4002-861f-39aa66d05715" released by "_create_volume_from_snapshot" :: held 9.164s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.202s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.575s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Creating offline snapshot 3dfcd734-7b61-41c5-b328-04b4b19d837c of volume a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc218d9-808e-4936-9611-04f41f51a5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e16bec-346b-4002-861f-39aa66d05715', 'volume_size': 1, 'snapshot_id': '7bba6475-8325-4496-a99c-16820289c545'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09272492-f1ab-4583-9a2d-c6723005f7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea2db2-92ff-4664-9574-8889738ae107]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:25 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Volume volume-45e16bec-346b-4002-861f-39aa66d05715 (45e16bec-346b-4002-861f-39aa66d05715): created successfully
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09272492-f1ab-4583-9a2d-c6723005f7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:25 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Flow 'volume_create_manager' (a6d1def7-78af-40bd-8e00-f99464183c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:25 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d73ea44a-bd61-466b-8875-a5872ec30817 tempest-SnapshotDependencyTests-647435203 None] Created volume successfully.
Jun 24 04:29:25 devstack sudo[109284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781
Jun 24 04:29:25 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:26 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781" returned: 0 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:26 devstack sudo[109295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c 1G
Jun 24 04:29:26 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-7bba6475-8325-4496-a99c-16820289c545-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-7bba6475-8325-4496-a99c-16820289c545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-quobyte-3d0a7140-81d7-4979-844c-1cc547cf9ee9" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-3d0a7140-81d7-4979-844c-1cc547cf9ee9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-quobyte-7bba6475-8325-4496-a99c-16820289c545" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-7bba6475-8325-4496-a99c-16820289c545" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Deleting offline snapshot 7bba6475-8325-4496-a99c-16820289c545 of volume 3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] snapshot_file for this snap is: volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee062d8-63d2-4cd8-bee7-b348806f5307]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:26 devstack sudo[109297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545
Jun 24 04:29:26 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:27 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c 1G" returned: 0 in 0.999s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:27 devstack sudo[109305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c
Jun 24 04:29:27 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:27 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545" returned: 0 in 0.865s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:27 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:27 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93c8f7d-1a33-4d6a-a8bd-25232a9f62ff]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:27 devstack sudo[109307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9
Jun 24 04:29:27 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:28 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c" returned: 0 in 0.884s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:28 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c is being set with open permissions: ugo+rw
Jun 24 04:29:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:28 devstack sudo[109315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c
Jun 24 04:29:28 devstack sudo[109315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:28 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9" returned: 0 in 0.879s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:28 devstack sudo[109317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545
Jun 24 04:29:28 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:28 devstack sudo[109315]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c" returned: 0 in 0.842s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:28 devstack sudo[109323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.info
Jun 24 04:29:28 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545" returned: 0 in 0.876s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:29 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:29 devstack sudo[109325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545
Jun 24 04:29:29 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:29 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.info" returned: 0 in 0.702s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:29 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.info is being set with open permissions: ugo+rw
Jun 24 04:29:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:29 devstack sudo[109328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.info
Jun 24 04:29:29 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:29 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9.7bba6475-8325-4496-a99c-16820289c545" returned: 0 in 0.800s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-7bba6475-8325-4496-a99c-16820289c545" released by "_delete_snapshot" :: held 3.557s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-3d0a7140-81d7-4979-844c-1cc547cf9ee9" released by "delete_snapshot" :: held 3.587s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:29 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Created reservations ['702f6866-2dbc-41cc-9443-ca63c4751787', '8dc0283e-2ef4-4917-bba4-16036b0b72f9', '5870b416-0358-4487-8588-a7443abc057f', '58402de0-c9c9-4978-8914-79abc64c1162'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Delete snapshot completed successfully.
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c9d9cedf-6886-445a-9868-001f50f3dd86 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-7bba6475-8325-4496-a99c-16820289c545-delete_snapshot" released by "delete_snapshot" :: held 3.780s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:30 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.info" returned: 0 in 0.734s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.133s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-69ee21dd-e146-4a82-8de0-29feb7cda141 tempest-VolumesDeleteCascade-523317533 None] Create snapshot completed successfully
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-3d0a7140-81d7-4979-844c-1cc547cf9ee9-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-3d0a7140-81d7-4979-844c-1cc547cf9ee9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-quobyte-3d0a7140-81d7-4979-844c-1cc547cf9ee9" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-3d0a7140-81d7-4979-844c-1cc547cf9ee9" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ad009-639a-4eca-bd9f-84e94f90483a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:30 devstack sudo[109333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9
Jun 24 04:29:30 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Flow 'volume_create_manager' (6aea6c12-175e-4787-829d-5d1f9d09a558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac116409-4372-4d9f-8df4-c1f4b71bc012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac116409-4372-4d9f-8df4-c1f4b71bc012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2002513552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976f9c0f-c7bd-4a6a-bac1-f2195d391953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6e3dadf6a14bcab63d6955e1015fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:31Z,use_quota=True,user_id='cbcb396e32c5407d93e5fb481f0e7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa7fa84-c99c-4144-a3e0-af4497099d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa7fa84-c99c-4144-a3e0-af4497099d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:31 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8fa4aa-340b-48bc-91c2-6568e580b693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8fa4aa-340b-48bc-91c2-6568e580b693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976f9c0f-c7bd-4a6a-bac1-f2195d391953', 'volume_name': 'volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5182e8-e1a0-4bbb-bec9-5774ea4d3c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5182e8-e1a0-4bbb-bec9-5774ea4d3c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0adea2-5b82-427d-aa53-b042a0ca679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Volume 976f9c0f-c7bd-4a6a-bac1-f2195d391953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953', 'volume_size': 1}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2002513552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976f9c0f-c7bd-4a6a-bac1-f2195d391953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6e3dadf6a14bcab63d6955e1015fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:31Z,use_quota=True,user_id='cbcb396e32c5407d93e5fb481f0e7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Creating volume 976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:31 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9" returned: 0 in 0.997s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:31 devstack sudo[109338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 1073741824
Jun 24 04:29:31 devstack sudo[109339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9
Jun 24 04:29:31 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:31 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Flow 'volume_create_manager' (616eb3dd-7bfa-4c0e-a890-c298b6344e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281e9604-3b95-4ad1-b652-16ce3fbdcdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281e9604-3b95-4ad1-b652-16ce3fbdcdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2092541004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0829290a-fe07-4cbf-9424-17382c00f7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9573fac7198846678c4250902ca75b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3dfcd734-7b61-41c5-b328-04b4b19d837c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:29:32Z,use_quota=True,user_id='1e3b1338aad14913af57aa3e33cddcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5dd2e8-3c87-4df6-8c85-51ca827a14ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c5dd2e8-3c87-4df6-8c85-51ca827a14ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a788e1a6-dfc6-45f9-b4ef-d4babbf321a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a788e1a6-dfc6-45f9-b4ef-d4babbf321a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0829290a-fe07-4cbf-9424-17382c00f7e3', 'volume_name': 'volume-0829290a-fe07-4cbf-9424-17382c00f7e3', 'volume_size': 1, 'snapshot_id': '3dfcd734-7b61-41c5-b328-04b4b19d837c'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef054e7d-4fa4-4c1f-ae6e-28397f08b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef054e7d-4fa4-4c1f-ae6e-28397f08b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a265691-4d85-4734-a4eb-ac3e1a267504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:32 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Volume 0829290a-fe07-4cbf-9424-17382c00f7e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0829290a-fe07-4cbf-9424-17382c00f7e3', 'volume_size': 1, 'snapshot_id': '3dfcd734-7b61-41c5-b328-04b4b19d837c'}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:32 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3d0a7140-81d7-4979-844c-1cc547cf9ee9" returned: 0 in 0.901s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-3d0a7140-81d7-4979-844c-1cc547cf9ee9" released by "delete_volume" :: held 1.973s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Created reservations ['4d714033-4b87-41db-9d66-7f58dbcd744d', '937acd20-1814-49dd-ac8d-0d7082013b60', '64293cff-f8b3-4172-8f3a-1769d9567a54', 'a429325e-64ba-4593-a6f8-8e6555f945e3'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:32 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 1073741824" returned: 0 in 1.055s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:32 devstack sudo[109350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:29:32 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:32 devstack sudo[109352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953
Jun 24 04:29:32 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-45e16bec-346b-4002-861f-39aa66d05715-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-45e16bec-346b-4002-861f-39aa66d05715-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "cinder-quobyte-45e16bec-346b-4002-861f-39aa66d05715" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-45e16bec-346b-4002-861f-39aa66d05715" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dafc56d-927c-4dc1-9efd-05aabdef8e7c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:33 devstack sudo[109356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715
Jun 24 04:29:33 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:33 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.817s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Deleted volume successfully.
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-aaa1bcfb-c5b0-4a7e-a8f6-0b1dbc9e9b59 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-3d0a7140-81d7-4979-844c-1cc547cf9ee9-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:33 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953" returned: 0 in 0.928s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.260s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-3dfcd734-7b61-41c5-b328-04b4b19d837c-0829290a-fe07-4cbf-9424-17382c00f7e3" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0adea2-5b82-427d-aa53-b042a0ca679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc048239-e17a-4657-86f6-4bbb2d3a04cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-3dfcd734-7b61-41c5-b328-04b4b19d837c-0829290a-fe07-4cbf-9424-17382c00f7e3" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Creating volume 0829290a-fe07-4cbf-9424-17382c00f7e3 from snapshot 3dfcd734-7b61-41c5-b328-04b4b19d837c {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-0829290a-fe07-4cbf-9424-17382c00f7e3" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-0829290a-fe07-4cbf-9424-17382c00f7e3" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] snapshot: 3dfcd734-7b61-41c5-b328-04b4b19d837c, volume: 0829290a-fe07-4cbf-9424-17382c00f7e3,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:29:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Volume volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 (976f9c0f-c7bd-4a6a-bac1-f2195d391953): created successfully
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc048239-e17a-4657-86f6-4bbb2d3a04cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Flow 'volume_create_manager' (6aea6c12-175e-4787-829d-5d1f9d09a558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-78e2c3e4-e128-4999-9dba-6ce88e413c5f tempest-TestStampPattern-769459146 None] Created volume successfully.
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d6dd1-29bd-42d9-95a0-98732b917982]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:33 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715" returned: 0 in 0.887s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:33 devstack sudo[109364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715
Jun 24 04:29:33 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:33 devstack sudo[109363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c
Jun 24 04:29:33 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:34 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-45e16bec-346b-4002-861f-39aa66d05715" returned: 0 in 0.684s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-quobyte-45e16bec-346b-4002-861f-39aa66d05715" released by "delete_volume" :: held 1.625s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:34 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c" returned: 0 in 0.798s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Created reservations ['de315391-c80d-4ee8-a9e3-ab672e5f04a9', '4cae659e-b0e7-49c9-83eb-37224616e874', '4e391f12-a81e-442f-99f9-924138c1879d', 'aa211170-7dba-4db6-ab6c-504039cd6db2'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ad503b-8f2e-48b3-9cd1-fa3e2938c5a6]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:34 devstack sudo[109372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:29:34 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:34 devstack sudo[109371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781
Jun 24 04:29:34 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:35 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.677s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:35 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Deleted volume successfully.
Jun 24 04:29:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f34a1ec8-e5aa-4464-bbeb-6fd160038b83 tempest-SnapshotDependencyTests-647435203 None] Lock "cinder-45e16bec-346b-4002-861f-39aa66d05715-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:35 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781" returned: 0 in 0.829s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:35 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:29:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:35 devstack sudo[109380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3
Jun 24 04:29:35 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:41 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3" returned: 0 in 6.357s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a7f9be-7548-4d06-8d9c-d11796ff0253]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:41 devstack sudo[109412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781
Jun 24 04:29:41 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:43 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781" returned: 0 in 1.196s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:29:43 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Converted 1024.00 MB image at 161.06 MB/s
Jun 24 04:29:43 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3 is being set with open permissions: ugo+rw
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:43 devstack sudo[109419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3
Jun 24 04:29:43 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:43 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3" returned: 0 in 0.689s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-0829290a-fe07-4cbf-9424-17382c00f7e3" released by "_copy_volume_from_snapshot" :: held 10.009s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-3dfcd734-7b61-41c5-b328-04b4b19d837c-0829290a-fe07-4cbf-9424-17382c00f7e3" released by "_create_volume_from_snapshot" :: held 10.050s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.088s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a265691-4d85-4734-a4eb-ac3e1a267504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0829290a-fe07-4cbf-9424-17382c00f7e3', 'volume_size': 1, 'snapshot_id': '3dfcd734-7b61-41c5-b328-04b4b19d837c'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e0d1ff-3ad6-4129-a782-06a66d3cc06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:29:43 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Volume volume-0829290a-fe07-4cbf-9424-17382c00f7e3 (0829290a-fe07-4cbf-9424-17382c00f7e3): created successfully
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e0d1ff-3ad6-4129-a782-06a66d3cc06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:29:43 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Flow 'volume_create_manager' (616eb3dd-7bfa-4c0e-a890-c298b6344e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:29:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-81762d7b-3413-45b3-ad10-3c95d4eea15f tempest-VolumesDeleteCascade-523317533 None] Created volume successfully.
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-a9574b29-d0bd-489d-b1dc-10fcbfb43781-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-a9574b29-d0bd-489d-b1dc-10fcbfb43781-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Performing cascade delete. {{(pid=93468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-3dfcd734-7b61-41c5-b328-04b4b19d837c-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-3dfcd734-7b61-41c5-b328-04b4b19d837c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-a9574b29-d0bd-489d-b1dc-10fcbfb43781" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-a9574b29-d0bd-489d-b1dc-10fcbfb43781" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-3dfcd734-7b61-41c5-b328-04b4b19d837c" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-3dfcd734-7b61-41c5-b328-04b4b19d837c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Deleting offline snapshot 3dfcd734-7b61-41c5-b328-04b4b19d837c of volume a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] snapshot_file for this snap is: volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b070008c-388e-41b6-a21f-b66eaf9f134b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:44 devstack sudo[109423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c
Jun 24 04:29:44 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:45 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c" returned: 0 in 0.919s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:29:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce64f27a-b96a-4b98-bae2-49719a819a42]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:45 devstack sudo[109429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781
Jun 24 04:29:45 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:46 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781" returned: 0 in 0.872s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:46 devstack sudo[109437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c
Jun 24 04:29:46 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:47 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c" returned: 0 in 0.763s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:47 devstack sudo[109442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c
Jun 24 04:29:47 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:47 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781.3dfcd734-7b61-41c5-b328-04b4b19d837c" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-3dfcd734-7b61-41c5-b328-04b4b19d837c" released by "_delete_snapshot" :: held 3.464s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-a9574b29-d0bd-489d-b1dc-10fcbfb43781" released by "delete_snapshot" :: held 3.489s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:48 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Created reservations ['48e86214-37ec-46c3-932f-1cb450f10c0b', 'a2154d29-ad87-4f75-b955-8eec8758a45e', '8814bc57-395b-436f-948e-9c60a884f74d', 'a81899ff-b461-4430-ad8b-2e4e282490e1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Delete snapshot completed successfully.
Jun 24 04:29:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-3dfcd734-7b61-41c5-b328-04b4b19d837c-delete_snapshot" released by "delete_snapshot" :: held 3.663s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:48 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Snapshots deleted, issuing volume delete {{(pid=93468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jun 24 04:29:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-a9574b29-d0bd-489d-b1dc-10fcbfb43781" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-a9574b29-d0bd-489d-b1dc-10fcbfb43781" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c36282-6d45-47f3-a540-0cfb6b265cdf]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:48 devstack sudo[109460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781
Jun 24 04:29:48 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:49 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781" returned: 0 in 1.414s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:49 devstack sudo[109543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781
Jun 24 04:29:49 devstack sudo[109543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:50 devstack sudo[109543]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a9574b29-d0bd-489d-b1dc-10fcbfb43781" returned: 0 in 1.070s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-a9574b29-d0bd-489d-b1dc-10fcbfb43781" released by "delete_volume" :: held 2.567s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Created reservations ['b1204e5c-a2e0-4016-9716-fe9bddedcc52', '502036b9-c557-46b5-875a-1da103631f6c', '1d1fb16d-5153-4940-9b87-b82861941a40', '788e159c-ebdb-4452-ae64-43664c98f31b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:50 devstack sudo[109574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:29:50 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-0829290a-fe07-4cbf-9424-17382c00f7e3-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-0829290a-fe07-4cbf-9424-17382c00f7e3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "cinder-quobyte-0829290a-fe07-4cbf-9424-17382c00f7e3" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-0829290a-fe07-4cbf-9424-17382c00f7e3" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc4a14c-0c84-4b48-b36f-b58c284a40ff]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:51 devstack sudo[109576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3
Jun 24 04:29:51 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:51 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.906s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Deleted volume successfully.
Jun 24 04:29:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3d03dbf0-41b6-4a4f-9abc-2c5f5a632369 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-a9574b29-d0bd-489d-b1dc-10fcbfb43781-delete_volume" released by "delete_volume" :: held 7.464s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:52 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3" returned: 0 in 0.842s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:52 devstack sudo[109582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3
Jun 24 04:29:52 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:53 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0829290a-fe07-4cbf-9424-17382c00f7e3" returned: 0 in 0.757s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-quobyte-0829290a-fe07-4cbf-9424-17382c00f7e3" released by "delete_volume" :: held 1.654s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Created reservations ['79e5b305-f93d-4a41-b7ed-1b4eca07c8ad', '7b11c9c0-e022-4442-8256-05b269363859', 'b96ebed9-aff4-4890-9495-e5e1db2bf864', 'e0e41f8f-7587-49e5-a506-7196619fc145'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:29:53 devstack sudo[109585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:29:53 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:29:53 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.738s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:29:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Deleted volume successfully.
Jun 24 04:29:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f4491cca-002e-4ce5-a0f6-8871ec96dbd8 tempest-VolumesDeleteCascade-523317533 None] Lock "cinder-0829290a-fe07-4cbf-9424-17382c00f7e3-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:30:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:30:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:30:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:30:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:01 devstack sudo[109592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:30:01 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:02 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.954s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:30:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:30:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:30:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:30:03 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:INSERT=20,cinder:UPDATE=89,cinder:SELECT=60,cinder:DELETE=3 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:30:03 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=72,cinder:INSERT=25,cinder:UPDATE=82,cinder:DELETE=10 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Flow 'volume_create_manager' (02d5ed06-b540-48b0-ad21-00a2b7e24b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578dc2b8-70f9-4ebd-b0b5-bcce684ae1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578dc2b8-70f9-4ebd-b0b5-bcce684ae1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1533907306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b899479-f231-47d6-891e-122ef3576bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec80f2b3f88c4de7acb4264b689b5c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:30:05Z,use_quota=True,user_id='1cda9a71c7aa44d5a8088274c50a4a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af68b12b-570b-4c1d-a260-0ca8c83ac6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af68b12b-570b-4c1d-a260-0ca8c83ac6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f0050c-8ff2-488a-9735-7a5e8ac563e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f0050c-8ff2-488a-9735-7a5e8ac563e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b899479-f231-47d6-891e-122ef3576bda', 'volume_name': 'volume-7b899479-f231-47d6-891e-122ef3576bda', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc962a49-5077-407b-8594-95efda33669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc962a49-5077-407b-8594-95efda33669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6c568e-30b3-45b5-9eda-2df28c49e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Volume 7b899479-f231-47d6-891e-122ef3576bda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b899479-f231-47d6-891e-122ef3576bda', 'volume_size': 1}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1533907306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b899479-f231-47d6-891e-122ef3576bda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec80f2b3f88c4de7acb4264b689b5c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:30:05Z,use_quota=True,user_id='1cda9a71c7aa44d5a8088274c50a4a64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Creating volume 7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:30:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:30:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:05 devstack sudo[109613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda 1073741824
Jun 24 04:30:05 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:06 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda 1073741824" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:06 devstack sudo[109619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:30:06 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:06 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 0.620s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6c568e-30b3-45b5-9eda-2df28c49e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b899479-f231-47d6-891e-122ef3576bda', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9489b495-ce0a-41cd-a948-65c02d190045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:06 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Volume volume-7b899479-f231-47d6-891e-122ef3576bda (7b899479-f231-47d6-891e-122ef3576bda): created successfully
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9489b495-ce0a-41cd-a948-65c02d190045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:06 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Flow 'volume_create_manager' (02d5ed06-b540-48b0-ad21-00a2b7e24b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:30:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6e8c0205-f29a-4209-8d03-c4d1c6a1d7e3 tempest-VolumesActionsTest-652881707 None] Created volume successfully.
Jun 24 04:30:16 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:30:16 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:30:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-bc52e056-b2b0-436c-bdf9-e51cff21ce24 req-be846b2a-f4db-46f3-9f87-8d4b893769f0 tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-bc52e056-b2b0-436c-bdf9-e51cff21ce24 req-be846b2a-f4db-46f3-9f87-8d4b893769f0 tempest-TestStampPattern-769459146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:18 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[81167291-31dd-401a-85ba-84ff0964273f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-bc52e056-b2b0-436c-bdf9-e51cff21ce24 req-be846b2a-f4db-46f3-9f87-8d4b893769f0 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:18 devstack sudo[109664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953
Jun 24 04:30:18 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:19 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-bc52e056-b2b0-436c-bdf9-e51cff21ce24 req-be846b2a-f4db-46f3-9f87-8d4b893769f0 tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953" returned: 0 in 0.776s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-bc52e056-b2b0-436c-bdf9-e51cff21ce24 req-be846b2a-f4db-46f3-9f87-8d4b893769f0 tempest-TestStampPattern-769459146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.798s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:19 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-bc52e056-b2b0-436c-bdf9-e51cff21ce24 req-be846b2a-f4db-46f3-9f87-8d4b893769f0 tempest-TestStampPattern-769459146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '545082b3-c92d-4ab3-9309-ee55d8911da4', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:30:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-bc52e056-b2b0-436c-bdf9-e51cff21ce24 req-be846b2a-f4db-46f3-9f87-8d4b893769f0 tempest-TestStampPattern-769459146 None] attachment_update completed successfully.
Jun 24 04:30:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae4ece14-a0b0-4b1e-b30a-2ccf4d914476 tempest-VolumesActionsTest-652881707 None] Acquiring lock "cinder-7b899479-f231-47d6-891e-122ef3576bda" by "attach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:30:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae4ece14-a0b0-4b1e-b30a-2ccf4d914476 tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda" acquired by "attach_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:30:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ae4ece14-a0b0-4b1e-b30a-2ccf4d914476 tempest-VolumesActionsTest-652881707 None] Attaching volume 7b899479-f231-47d6-891e-122ef3576bda to instance f971d46e-7bb0-4743-98fc-915e396026bf at mountpoint /dev/vdb on host None.
Jun 24 04:30:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ae4ece14-a0b0-4b1e-b30a-2ccf4d914476 tempest-VolumesActionsTest-652881707 None] Attach volume completed successfully.
Jun 24 04:30:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ae4ece14-a0b0-4b1e-b30a-2ccf4d914476 tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda" released by "attach_volume" :: held 0.092s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:30:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34734b6-e990-4516-8b0e-591b4dea7c30 tempest-VolumesActionsTest-652881707 None] Acquiring lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-detach_volume" by "detach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:30:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34734b6-e990-4516-8b0e-591b4dea7c30 tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:30:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b34734b6-e990-4516-8b0e-591b4dea7c30 tempest-VolumesActionsTest-652881707 None] Detaching volume 7b899479-f231-47d6-891e-122ef3576bda from instance f971d46e-7bb0-4743-98fc-915e396026bf.
Jun 24 04:30:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b34734b6-e990-4516-8b0e-591b4dea7c30 tempest-VolumesActionsTest-652881707 None] Detach volume completed successfully.
Jun 24 04:30:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b34734b6-e990-4516-8b0e-591b4dea7c30 tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:30:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-cbee3369-e1a3-4858-a238-2055398e9c82 req-7e031a73-7a72-4001-ae78-8d1fa84f5888 tempest-TestStampPattern-769459146 None] Terminate volume connection completed successfully.
Jun 24 04:30:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-cbee3369-e1a3-4858-a238-2055398e9c82 req-7e031a73-7a72-4001-ae78-8d1fa84f5888 tempest-TestStampPattern-769459146 None] Deleting attachment 545082b3-c92d-4ab3-9309-ee55d8911da4. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Creating offline snapshot e3d4832c-bfa9-45dc-ab98-c08f5696cd6c of volume 976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:30:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64d4356-c15b-4a3c-a41e-f4ca347cff65]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:30 devstack sudo[110255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953
Jun 24 04:30:30 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:31 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953" returned: 0 in 0.739s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:31 devstack sudo[110261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c 1G
Jun 24 04:30:31 devstack sudo[110261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:31 devstack sudo[110261]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c 1G" returned: 0 in 0.831s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:31 devstack sudo[110267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c
Jun 24 04:30:31 devstack sudo[110267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:32 devstack sudo[110267]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" returned: 0 in 0.739s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:32 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c is being set with open permissions: ugo+rw
Jun 24 04:30:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:32 devstack sudo[110275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c
Jun 24 04:30:32 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:33 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" returned: 0 in 0.681s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:33 devstack sudo[110280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.info
Jun 24 04:30:33 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:34 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.info" returned: 0 in 0.634s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:34 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.info is being set with open permissions: ugo+rw
Jun 24 04:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:34 devstack sudo[110283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.info
Jun 24 04:30:34 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:34 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.info" returned: 0 in 0.661s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.371s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-028ae41b-884c-41e1-ab4b-99bff7931220 tempest-TestStampPattern-769459146 None] Create snapshot completed successfully
Jun 24 04:30:44 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:30:44 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Flow 'volume_create_manager' (a9bff7b4-bc71-4942-86f2-95a3bcf54bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e66103-2696-4bf9-bc80-756c858f28c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e66103-2696-4bf9-bc80-756c858f28c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1319566269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31271288-eed0-4247-9a5e-65f8df22e4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6e3dadf6a14bcab63d6955e1015fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3d4832c-bfa9-45dc-ab98-c08f5696cd6c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:30:45Z,use_quota=True,user_id='cbcb396e32c5407d93e5fb481f0e7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2d24b5-f670-4331-acad-c965acf73480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2d24b5-f670-4331-acad-c965acf73480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd791973-089c-496e-883c-d0d22c564efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd791973-089c-496e-883c-d0d22c564efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31271288-eed0-4247-9a5e-65f8df22e4a4', 'volume_name': 'volume-31271288-eed0-4247-9a5e-65f8df22e4a4', 'volume_size': 1, 'snapshot_id': 'e3d4832c-bfa9-45dc-ab98-c08f5696cd6c'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35734f62-d839-4c15-9b87-62c4b3974de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35734f62-d839-4c15-9b87-62c4b3974de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339bfac7-099e-495a-b8ec-53e7745a65e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Volume 31271288-eed0-4247-9a5e-65f8df22e4a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31271288-eed0-4247-9a5e-65f8df22e4a4', 'volume_size': 1, 'snapshot_id': 'e3d4832c-bfa9-45dc-ab98-c08f5696cd6c'}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-quobyte-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c-31271288-eed0-4247-9a5e-65f8df22e4a4" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c-31271288-eed0-4247-9a5e-65f8df22e4a4" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Creating volume 31271288-eed0-4247-9a5e-65f8df22e4a4 from snapshot e3d4832c-bfa9-45dc-ab98-c08f5696cd6c {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-quobyte-31271288-eed0-4247-9a5e-65f8df22e4a4" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-31271288-eed0-4247-9a5e-65f8df22e4a4" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] snapshot: e3d4832c-bfa9-45dc-ab98-c08f5696cd6c, volume: 31271288-eed0-4247-9a5e-65f8df22e4a4,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83c9e4a-34cc-4a2a-8f6a-d0c059dda45f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:45 devstack sudo[110429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c
Jun 24 04:30:45 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:46 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" returned: 0 in 0.986s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:30:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:30:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:30:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a8704-fe1b-4ad1-9af4-9fcc29e65170]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:46 devstack sudo[110437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953
Jun 24 04:30:46 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53625304-e74b-4f5d-ac19-f12b314b1f5b tempest-VolumesActionsTest-652881707 None] Acquiring lock "cinder-7b899479-f231-47d6-891e-122ef3576bda" by "attach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:30:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53625304-e74b-4f5d-ac19-f12b314b1f5b tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda" acquired by "attach_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:30:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-53625304-e74b-4f5d-ac19-f12b314b1f5b tempest-VolumesActionsTest-652881707 None] Attaching volume 7b899479-f231-47d6-891e-122ef3576bda to instance 72b01401-758c-4038-9756-7f577fff4b4e at mountpoint /dev/vdb on host None.
Jun 24 04:30:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-53625304-e74b-4f5d-ac19-f12b314b1f5b tempest-VolumesActionsTest-652881707 None] Attach volume completed successfully.
Jun 24 04:30:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-53625304-e74b-4f5d-ac19-f12b314b1f5b tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda" released by "attach_volume" :: held 0.106s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:30:47 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953" returned: 0 in 1.067s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:47 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:30:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:47 devstack sudo[110442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4
Jun 24 04:30:47 devstack sudo[110442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-71c9e04a-9298-43c1-a847-ca5d60d91491 tempest-VolumesActionsTest-652881707 None] Acquiring lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-detach_volume" by "detach_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:30:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-71c9e04a-9298-43c1-a847-ca5d60d91491 tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:30:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-71c9e04a-9298-43c1-a847-ca5d60d91491 tempest-VolumesActionsTest-652881707 None] Detaching volume 7b899479-f231-47d6-891e-122ef3576bda from instance 72b01401-758c-4038-9756-7f577fff4b4e.
Jun 24 04:30:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-71c9e04a-9298-43c1-a847-ca5d60d91491 tempest-VolumesActionsTest-652881707 None] Detach volume completed successfully.
Jun 24 04:30:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-71c9e04a-9298-43c1-a847-ca5d60d91491 tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:30:55 devstack sudo[110442]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4" returned: 0 in 7.595s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:55 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c7358-920f-4465-9420-067224852a25]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:55 devstack sudo[110581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953
Jun 24 04:30:55 devstack sudo[110581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:56 devstack sudo[110581]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953" returned: 0 in 1.267s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:56 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953, size 1024.00 MB, duration 7.60 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:30:56 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Converted 1024.00 MB image at 134.80 MB/s
Jun 24 04:30:56 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4 is being set with open permissions: ugo+rw
Jun 24 04:30:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:30:56 devstack sudo[110590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4
Jun 24 04:30:56 devstack sudo[110590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:30:57 devstack sudo[110590]: pam_unix(sudo:session): session closed for user root
Jun 24 04:30:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4" returned: 0 in 0.698s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:30:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-31271288-eed0-4247-9a5e-65f8df22e4a4" released by "_copy_volume_from_snapshot" :: held 11.759s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:30:57 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c-31271288-eed0-4247-9a5e-65f8df22e4a4" released by "_create_volume_from_snapshot" :: held 11.795s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:30:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.818s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:30:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339bfac7-099e-495a-b8ec-53e7745a65e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31271288-eed0-4247-9a5e-65f8df22e4a4', 'volume_size': 1, 'snapshot_id': 'e3d4832c-bfa9-45dc-ab98-c08f5696cd6c'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd16e1e-05a0-4cb4-a0c1-45dfbac0ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:30:57 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Volume volume-31271288-eed0-4247-9a5e-65f8df22e4a4 (31271288-eed0-4247-9a5e-65f8df22e4a4): created successfully
Jun 24 04:30:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd16e1e-05a0-4cb4-a0c1-45dfbac0ba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:30:57 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Flow 'volume_create_manager' (a9bff7b4-bc71-4942-86f2-95a3bcf54bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:30:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dbb9aad4-8937-4cc1-9c42-82eb2d99c396 tempest-TestStampPattern-769459146 None] Created volume successfully.
Jun 24 04:30:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:30:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:30:59 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1d10c5-448a-4936-acc1-673f176ac647]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:30:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:00 devstack sudo[110620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:31:00 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:00 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 0.731s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90cd57a-1316-49ac-9bc7-9c2dfd3c948b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:00 devstack sudo[110625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:31:00 devstack sudo[110625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:01 devstack sudo[110625]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.f56263f9-0a9d-4259-a983-0dfc9c40658a5sfv01wu.img {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:01 devstack sudo[110636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.f56263f9-0a9d-4259-a983-0dfc9c40658a5sfv01wu.img
Jun 24 04:31:01 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:01 devstack sudo[110646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:31:01 devstack sudo[110646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:03 devstack sudo[110646]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.983s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:03 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:31:03 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:31:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:31:07 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:31:08 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.f56263f9-0a9d-4259-a983-0dfc9c40658a5sfv01wu.img" returned: 0 in 7.009s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e41b067-5917-4dde-99c5-7c992382a06e]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:08 devstack sudo[110705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:31:08 devstack sudo[110705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:09 devstack sudo[110705]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 1.115s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:09 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.f56263f9-0a9d-4259-a983-0dfc9c40658a5sfv01wu.img {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:31:09 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Converted 1024.00 MB image at 146.06 MB/s
Jun 24 04:31:09 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] f56263f9-0a9d-4259-a983-0dfc9c40658a was raw, no need to convert to raw {{(pid=93468) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jun 24 04:31:26 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:31:26 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:31:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.885s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Uploaded volume to glance image-id: f56263f9-0a9d-4259-a983-0dfc9c40658a. {{(pid=93468) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 24 04:31:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2d305dfb-a698-480a-96c1-166e7eac7771 tempest-VolumesActionsTest-652881707 None] Copy volume to image completed successfully.
Jun 24 04:31:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca124e4-9879-42ff-b682-d8636e499df9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:30 devstack sudo[110748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:31:30 devstack sudo[110748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:30 devstack sudo[110748]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 0.818s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2356e011-5dba-46fe-9c10-9af7cd16b7b0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:31 devstack sudo[110754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:31:31 devstack sudo[110754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:31 devstack sudo[110754]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 0.756s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:31 devstack sudo[110763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img
Jun 24 04:31:31 devstack sudo[110763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-0ec1ed90-9ff4-47f0-8a3d-3bb53f33571e req-c7083f06-d66b-4d2a-bc44-92389d56fc16 tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:36 devstack sudo[110763]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img" returned: 0 in 4.677s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:36 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74828a4-7701-41a3-93e8-16d8fa124e47]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:36 devstack sudo[110790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:31:36 devstack sudo[110790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:37 devstack sudo[110790]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 0.926s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:37 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:31:37 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Converted 1024.00 MB image at 218.89 MB/s
Jun 24 04:31:37 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] 3f6c8e1a-afec-4bd9-8e85-fcf5d5674567 was raw, converting to qcow2 {{(pid=93468) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jun 24 04:31:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7165e8-17a4-433e-84fe-f6ebf3d975be]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:37 devstack sudo[110796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img
Jun 24 04:31:37 devstack sudo[110796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:38 devstack sudo[110796]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img" returned: 0 in 0.706s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:38 devstack sudo[110800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img
Jun 24 04:31:38 devstack sudo[110800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:38 devstack sudo[110800]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img" returned: 1 in 0.719s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:31:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img /opt/stack/data/cinder/conversion/vol_upload_8_jfas3a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:38 devstack sudo[110805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img /opt/stack/data/cinder/conversion/vol_upload_8_jfas3a
Jun 24 04:31:38 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:39 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img /opt/stack/data/cinder/conversion/vol_upload_8_jfas3a" returned: 0 in 0.637s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:39 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Image conversion details: src /opt/stack/data/cinder/conversion/7b899479-f231-47d6-891e-122ef3576bda.temp_image.3f6c8e1a-afec-4bd9-8e85-fcf5d5674567wwj_n8lt.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8_jfas3a {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:31:39 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Converted 1024.00 MB image at 1024.00 MB/s
Jun 24 04:31:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c190caf6-bb26-4332-86e6-25f033581287]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8_jfas3a {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:39 devstack sudo[110810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8_jfas3a
Jun 24 04:31:39 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:40 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8_jfas3a" returned: 0 in 0.715s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.251s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Uploaded volume to glance image-id: 3f6c8e1a-afec-4bd9-8e85-fcf5d5674567. {{(pid=93468) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jun 24 04:31:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-0ec1ed90-9ff4-47f0-8a3d-3bb53f33571e req-c7083f06-d66b-4d2a-bc44-92389d56fc16 tempest-TestStampPattern-769459146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.713s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:41 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a6484d-1147-4e89-ab58-6067db74b7d1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-0ec1ed90-9ff4-47f0-8a3d-3bb53f33571e req-c7083f06-d66b-4d2a-bc44-92389d56fc16 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7e5f3e8c-7094-4618-9e62-a936e231f158 tempest-VolumesActionsTest-652881707 None] Copy volume to image completed successfully.
Jun 24 04:31:41 devstack sudo[110815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4
Jun 24 04:31:41 devstack sudo[110815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:42 devstack sudo[110815]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [req-0ec1ed90-9ff4-47f0-8a3d-3bb53f33571e req-c7083f06-d66b-4d2a-bc44-92389d56fc16 tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4" returned: 0 in 0.853s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [req-0ec1ed90-9ff4-47f0-8a3d-3bb53f33571e req-c7083f06-d66b-4d2a-bc44-92389d56fc16 tempest-TestStampPattern-769459146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Acquiring lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-0ec1ed90-9ff4-47f0-8a3d-3bb53f33571e req-c7083f06-d66b-4d2a-bc44-92389d56fc16 tempest-TestStampPattern-769459146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e', 'name': 'volume-31271288-eed0-4247-9a5e-65f8df22e4a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a59cc0b3-800c-43a8-a6ea-8491f36139fc', 'enforce_multipath': True} {{(pid=93468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Acquiring lock "cinder-quobyte-7b899479-f231-47d6-891e-122ef3576bda" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Lock "cinder-quobyte-7b899479-f231-47d6-891e-122ef3576bda" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca0549-8467-4381-a684-4b45c33ba88f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-0ec1ed90-9ff4-47f0-8a3d-3bb53f33571e req-c7083f06-d66b-4d2a-bc44-92389d56fc16 tempest-TestStampPattern-769459146 None] attachment_update completed successfully.
Jun 24 04:31:42 devstack sudo[110820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:31:42 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:43 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 0.805s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:43 devstack sudo[110892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda
Jun 24 04:31:43 devstack sudo[110892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:43 devstack sudo[110892]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7b899479-f231-47d6-891e-122ef3576bda" returned: 0 in 0.704s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Lock "cinder-quobyte-7b899479-f231-47d6-891e-122ef3576bda" released by "delete_volume" :: held 1.544s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:31:43 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Created reservations ['7cc35432-0ccb-46cb-87f0-a16e6f24e988', 'daecadc2-b227-4353-8f68-d77d04c3eb51', '1f9ddb31-d758-45d1-8e62-1769f219be3e', '37ba06ce-6f01-4521-a0c7-67c95568762f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:44 devstack sudo[111213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:31:44 devstack sudo[111213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:44 devstack sudo[111213]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.691s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:31:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Deleted volume successfully.
Jun 24 04:31:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a9568e6e-4a9f-4b16-9558-436c12fc822d tempest-VolumesActionsTest-652881707 None] Lock "cinder-7b899479-f231-47d6-891e-122ef3576bda-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:31:49 devstack cinder-volume[93468]: INFO cinder.volume.manager [req-df76853e-c9ec-42e8-9a26-e44e5e84bdfb req-a3ca2dea-8399-446f-8121-221fdc7b2f36 tempest-TestStampPattern-769459146 None] Terminate volume connection completed successfully.
Jun 24 04:31:49 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [req-df76853e-c9ec-42e8-9a26-e44e5e84bdfb req-a3ca2dea-8399-446f-8121-221fdc7b2f36 tempest-TestStampPattern-769459146 None] Deleting attachment a59cc0b3-800c-43a8-a6ea-8491f36139fc. {{(pid=93468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Flow 'volume_create_manager' (b820a7fe-9dff-4548-83c5-ee6ae907e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354e71de-1269-464d-a59e-2fb4a871d9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354e71de-1269-464d-a59e-2fb4a871d9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-32113363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8013664-2690-4292-8ea0-a3dee0bbe9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ad06d1aa06492bb0ed6e63875d35d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:31:50Z,use_quota=True,user_id='e308770874b24897a7afff33fc58d842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2254738-6b17-492e-9413-e02b03e7b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2254738-6b17-492e-9413-e02b03e7b32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ed6aa5-6c4e-49c4-85ea-eabc05f30772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ed6aa5-6c4e-49c4-85ea-eabc05f30772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8013664-2690-4292-8ea0-a3dee0bbe9b3', 'volume_name': 'volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f331dbf-267b-4b7e-9db1-68f20f38e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f331dbf-267b-4b7e-9db1-68f20f38e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975a0caa-8216-4b68-96f8-d7a8de1c7955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:50 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Volume d8013664-2690-4292-8ea0-a3dee0bbe9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3', 'volume_size': 1}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-32113363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8013664-2690-4292-8ea0-a3dee0bbe9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ad06d1aa06492bb0ed6e63875d35d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:31:50Z,use_quota=True,user_id='e308770874b24897a7afff33fc58d842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Creating volume d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:31:50 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:31:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:50 devstack sudo[111266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 1073741824
Jun 24 04:31:50 devstack sudo[111266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:51 devstack sudo[111266]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 1073741824" returned: 0 in 0.783s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:51 devstack sudo[111271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3
Jun 24 04:31:51 devstack sudo[111271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:51 devstack sudo[111271]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3" returned: 0 in 0.643s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975a0caa-8216-4b68-96f8-d7a8de1c7955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df542d13-df90-4c73-9f24-be509f037ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:31:51 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Volume volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 (d8013664-2690-4292-8ea0-a3dee0bbe9b3): created successfully
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df542d13-df90-4c73-9f24-be509f037ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:31:51 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Flow 'volume_create_manager' (b820a7fe-9dff-4548-83c5-ee6ae907e889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:31:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7f307899-b3cc-4d2b-b6cd-5edc01b74bfe tempest-VolumesSnapshotListTestJSON-1735286446 None] Created volume successfully.
Jun 24 04:31:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Creating offline snapshot 0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 of volume d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:31:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[049af446-3afe-4e50-84f4-85d446dea34b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:52 devstack sudo[111276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3
Jun 24 04:31:52 devstack sudo[111276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:53 devstack sudo[111276]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:53 devstack sudo[111332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 1G
Jun 24 04:31:53 devstack sudo[111332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:54 devstack sudo[111332]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 1G" returned: 0 in 0.902s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:54 devstack sudo[111363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3
Jun 24 04:31:54 devstack sudo[111363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:55 devstack sudo[111363]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" returned: 0 in 0.693s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:55 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 is being set with open permissions: ugo+rw
Jun 24 04:31:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:55 devstack sudo[111370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3
Jun 24 04:31:55 devstack sudo[111370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:55 devstack sudo[111370]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" returned: 0 in 0.688s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:55 devstack sudo[111374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.info
Jun 24 04:31:55 devstack sudo[111374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:56 devstack sudo[111374]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.info" returned: 0 in 0.628s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:56 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.info is being set with open permissions: ugo+rw
Jun 24 04:31:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:56 devstack sudo[111377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.info
Jun 24 04:31:56 devstack sudo[111377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:57 devstack sudo[111377]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.info" returned: 0 in 0.638s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.498s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:31:57 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-552361f6-77ac-43b5-b741-80d1f979fd59 tempest-VolumesSnapshotListTestJSON-1735286446 None] Create snapshot completed successfully
Jun 24 04:31:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:31:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:31:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Creating offline snapshot 1f4ed81c-c057-451f-8628-712d53a3cdd2 of volume d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2e7acc-b46e-4952-9ce9-278b94c0f939]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:58 devstack sudo[111380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3
Jun 24 04:31:58 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-31271288-eed0-4247-9a5e-65f8df22e4a4-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Lock "cinder-31271288-eed0-4247-9a5e-65f8df22e4a4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-quobyte-31271288-eed0-4247-9a5e-65f8df22e4a4" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-31271288-eed0-4247-9a5e-65f8df22e4a4" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da634c-4d1b-4b42-98e9-40bd3cd049f3]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:58 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" returned: 0 in 0.772s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:31:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:58 devstack sudo[111387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 1G
Jun 24 04:31:58 devstack sudo[111387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:58 devstack sudo[111386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4
Jun 24 04:31:58 devstack sudo[111386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:59 devstack sudo[111386]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:59 devstack sudo[111396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4
Jun 24 04:31:59 devstack sudo[111396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:31:59 devstack sudo[111387]: pam_unix(sudo:session): session closed for user root
Jun 24 04:31:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 1G" returned: 0 in 0.858s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:31:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:31:59 devstack sudo[111398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2
Jun 24 04:31:59 devstack sudo[111398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:00 devstack sudo[111396]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-31271288-eed0-4247-9a5e-65f8df22e4a4" returned: 0 in 0.673s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-31271288-eed0-4247-9a5e-65f8df22e4a4" released by "delete_volume" :: held 1.522s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Created reservations ['ab316579-cd29-46e8-afda-ede5ac8861b8', 'f861e712-b87b-4fdc-a06f-3604c6d12556', '1a608852-961e-4335-89bc-4de5baf36b18', 'bac94a7b-2468-4abd-acd8-8f68659c6799'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:00 devstack sudo[111398]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2" returned: 0 in 0.727s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:00 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 is being set with open permissions: ugo+rw
Jun 24 04:32:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:00 devstack sudo[111405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:00 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:00 devstack sudo[111406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2
Jun 24 04:32:00 devstack sudo[111406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:01 devstack sudo[111406]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2" returned: 0 in 0.646s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:01 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Deleted volume successfully.
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.115s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-24361e6d-1791-4478-9ad5-801ace410c89 tempest-VolumesSnapshotListTestJSON-1735286446 None] Create snapshot completed successfully
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a5935d01-81c0-4179-9dac-340539cc0805 tempest-TestStampPattern-769459146 None] Lock "cinder-31271288-eed0-4247-9a5e-65f8df22e4a4-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Lock "cinder-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-quobyte-976f9c0f-c7bd-4a6a-bac1-f2195d391953" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-976f9c0f-c7bd-4a6a-bac1-f2195d391953" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-quobyte-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Deleting offline snapshot e3d4832c-bfa9-45dc-ab98-c08f5696cd6c of volume 976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] snapshot_file for this snap is: volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b694eaa-cb33-45a9-bf73-b40df4c7e51d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:01 devstack sudo[111411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c
Jun 24 04:32:01 devstack sudo[111411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:01 devstack sudo[111413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:01 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:01 devstack sudo[111411]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" returned: 0 in 0.740s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e316d9-a3f1-40c4-af42-aedb910197ea]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:02 devstack sudo[111418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953
Jun 24 04:32:02 devstack sudo[111418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Creating offline snapshot 83f9606e-89fc-4e8c-9e79-5a3199c936fc of volume d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dada666-94db-46ab-b67a-495672779f9c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:02 devstack sudo[111420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2
Jun 24 04:32:02 devstack sudo[111420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:02 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.738s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:32:02 devstack sudo[111418]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953" returned: 0 in 0.771s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:02 devstack sudo[111426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c
Jun 24 04:32:02 devstack sudo[111426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:03 devstack sudo[111420]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2" returned: 0 in 0.765s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:32:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:03 devstack sudo[111431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc 1G
Jun 24 04:32:03 devstack sudo[111431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:03 devstack sudo[111426]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" returned: 0 in 0.746s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:03 devstack sudo[111436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c
Jun 24 04:32:03 devstack sudo[111436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:03 devstack sudo[111431]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc 1G" returned: 0 in 0.826s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:04 devstack sudo[111441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc
Jun 24 04:32:04 devstack sudo[111441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:04 devstack sudo[111436]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953.e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" returned: 0 in 0.659s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c" released by "_delete_snapshot" :: held 3.030s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-976f9c0f-c7bd-4a6a-bac1-f2195d391953" released by "delete_snapshot" :: held 3.052s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:04 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Created reservations ['2ef58d01-bc10-4632-b4fe-0edb0bd13657', 'c5c65c42-6d1b-4510-8472-fe556e9d6419', '8480ed98-32ba-4c3e-904b-03a3c210a0bf', '61e3b161-e0d0-44ed-a70a-a8c4aa4564fa'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:04 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Delete snapshot completed successfully.
Jun 24 04:32:04 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4da0cd1e-a865-4816-bb8e-91e2fb02954d tempest-TestStampPattern-769459146 None] Lock "cinder-e3d4832c-bfa9-45dc-ab98-c08f5696cd6c-delete_snapshot" released by "delete_snapshot" :: held 3.204s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:04 devstack sudo[111441]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc" returned: 0 in 0.719s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:04 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc is being set with open permissions: ugo+rw
Jun 24 04:32:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:04 devstack sudo[111447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc
Jun 24 04:32:04 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:05 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc" returned: 0 in 0.613s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3dc3bc16-4b3b-420b-aae0-994b14e211b3 tempest-VolumesSnapshotListTestJSON-1735286446 None] Create snapshot completed successfully
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-83f9606e-89fc-4e8c-9e79-5a3199c936fc-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-83f9606e-89fc-4e8c-9e79-5a3199c936fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-quobyte-83f9606e-89fc-4e8c-9e79-5a3199c936fc" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-83f9606e-89fc-4e8c-9e79-5a3199c936fc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Deleting offline snapshot 83f9606e-89fc-4e8c-9e79-5a3199c936fc of volume d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] snapshot_file for this snap is: volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c001e5-d701-48ec-a9f2-077da7dfb461]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:06 devstack sudo[111453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc
Jun 24 04:32:06 devstack sudo[111453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:07 devstack sudo[111453]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc" returned: 0 in 0.760s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:32:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ef07a-68eb-44d1-ad12-35310c62867f]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:07 devstack sudo[111459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2
Jun 24 04:32:07 devstack sudo[111459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:08 devstack sudo[111459]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2" returned: 0 in 1.132s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:32:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:08 devstack sudo[111546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc
Jun 24 04:32:08 devstack sudo[111546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:09 devstack sudo[111546]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc" returned: 0 in 1.038s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:09 devstack sudo[111568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc
Jun 24 04:32:09 devstack sudo[111568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:10 devstack sudo[111568]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.83f9606e-89fc-4e8c-9e79-5a3199c936fc" returned: 0 in 0.617s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-83f9606e-89fc-4e8c-9e79-5a3199c936fc" released by "_delete_snapshot" :: held 3.640s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" released by "delete_snapshot" :: held 3.666s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Created reservations ['93045add-d255-443e-83db-abfa9b9f987b', 'fab4df8b-eba0-4bc8-ae16-f9f7a9ceeeed', '0c0e2ce0-22e5-43c9-969e-4d9eac25d1d8', 'dd5dcd25-39a1-4bed-88f6-1fe6301e43c6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Delete snapshot completed successfully.
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1271b630-2472-42fb-8628-aeb5acd43525 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-83f9606e-89fc-4e8c-9e79-5a3199c936fc-delete_snapshot" released by "delete_snapshot" :: held 3.801s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-1f4ed81c-c057-451f-8628-712d53a3cdd2-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-1f4ed81c-c057-451f-8628-712d53a3cdd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-quobyte-1f4ed81c-c057-451f-8628-712d53a3cdd2" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-1f4ed81c-c057-451f-8628-712d53a3cdd2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Deleting offline snapshot 1f4ed81c-c057-451f-8628-712d53a3cdd2 of volume d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] snapshot_file for this snap is: volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af91e4b-40cb-4e76-ada9-61d30ce3727e]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:10 devstack sudo[111571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2
Jun 24 04:32:10 devstack sudo[111571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:11 devstack sudo[111571]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2" returned: 0 in 0.777s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:11 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:32:11 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b557ee21-d37b-48b9-8ae5-e5c06eeb0d3d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:11 devstack sudo[111576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3
Jun 24 04:32:11 devstack sudo[111576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:12 devstack sudo[111576]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" returned: 0 in 0.756s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:32:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:12 devstack sudo[111581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2
Jun 24 04:32:12 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-976f9c0f-c7bd-4a6a-bac1-f2195d391953-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Lock "cinder-976f9c0f-c7bd-4a6a-bac1-f2195d391953-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Acquiring lock "cinder-quobyte-976f9c0f-c7bd-4a6a-bac1-f2195d391953" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-976f9c0f-c7bd-4a6a-bac1-f2195d391953" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c9f58-ba76-4977-acad-1f2dac7afa13]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:13 devstack sudo[111587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953
Jun 24 04:32:13 devstack sudo[111587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:13 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2" returned: 0 in 0.830s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:13 devstack sudo[111589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2
Jun 24 04:32:13 devstack sudo[111589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953" returned: 0 in 0.778s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:13 devstack sudo[111587]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:13 devstack sudo[111589]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:13 devstack sudo[111595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.1f4ed81c-c057-451f-8628-712d53a3cdd2" returned: 0 in 0.679s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:13 devstack sudo[111595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-1f4ed81c-c057-451f-8628-712d53a3cdd2" released by "_delete_snapshot" :: held 3.147s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" released by "delete_snapshot" :: held 3.168s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Created reservations ['36bf1f9b-d847-443b-a5e7-fdea5b8ec4d6', '39b7afe2-abcd-4003-8ff5-a29f92f617a6', '4270c088-329c-457b-b23f-25ce0e03dc86', '0d4259b9-6e1a-4ad9-a898-65c89e77f3b4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Delete snapshot completed successfully.
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0cf110eb-288f-4f1d-80bd-28f28dfda836 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-1f4ed81c-c057-451f-8628-712d53a3cdd2-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:14 devstack sudo[111595]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-976f9c0f-c7bd-4a6a-bac1-f2195d391953" returned: 0 in 0.682s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Lock "cinder-quobyte-976f9c0f-c7bd-4a6a-bac1-f2195d391953" released by "delete_volume" :: held 1.514s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Created reservations ['51672b89-9c57-4b10-ba52-13ef5720b5d1', '250913be-d41d-4b5d-bde6-e0c3648cbeb0', '2f27f047-997c-426e-b6a1-4d118b9dcde0', 'c5e337a1-82ca-46ec-a647-d3c07c595277'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:14 devstack sudo[111598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:14 devstack sudo[111598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-quobyte-0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Deleting offline snapshot 0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 of volume d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] snapshot_file for this snap is: volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b52af5-a2be-4c1e-9af4-eb257e38a722]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:15 devstack sudo[111601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3
Jun 24 04:32:15 devstack sudo[111601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:15 devstack sudo[111598]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.692s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Deleted volume successfully.
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-ccc8bfdc-b21b-4241-a83f-5781d87c90a2 tempest-TestStampPattern-769459146 None] Lock "cinder-976f9c0f-c7bd-4a6a-bac1-f2195d391953-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:15 devstack sudo[111601]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05ed5f6-8632-4ecd-a2ec-6d3343b7ca6d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:16 devstack sudo[111607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3
Jun 24 04:32:16 devstack sudo[111607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:16 devstack sudo[111607]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:16 devstack sudo[111612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3
Jun 24 04:32:16 devstack sudo[111612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:17 devstack sudo[111612]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" returned: 0 in 0.730s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:17 devstack sudo[111619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3
Jun 24 04:32:17 devstack sudo[111619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:18 devstack sudo[111619]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3.0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" returned: 0 in 0.726s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3" released by "_delete_snapshot" :: held 3.188s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" released by "delete_snapshot" :: held 3.216s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Created reservations ['57cf4825-c293-4897-9569-ac6c150d53f2', 'ad314c3e-4acc-4bdf-b7a4-cf734880d4b3', '12d01843-25b9-412e-8f03-0950068ce470', '38282334-af8d-478e-ac44-0c02adb3bdca'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Delete snapshot completed successfully.
Jun 24 04:32:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0859d1dd-a0ba-4a11-8ad7-6e0711a952a5 tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-0d7f3a34-c6ba-41d9-a9ef-22459c0db6c3-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-d8013664-2690-4292-8ea0-a3dee0bbe9b3-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-d8013664-2690-4292-8ea0-a3dee0bbe9b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[590199a0-9563-43af-88e0-1e82f65a8fdf]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:19 devstack sudo[111623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3
Jun 24 04:32:19 devstack sudo[111623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:20 devstack sudo[111623]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:20 devstack sudo[111628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3
Jun 24 04:32:20 devstack sudo[111628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:20 devstack sudo[111628]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d8013664-2690-4292-8ea0-a3dee0bbe9b3" returned: 0 in 0.719s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-quobyte-d8013664-2690-4292-8ea0-a3dee0bbe9b3" released by "delete_volume" :: held 1.587s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:20 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Created reservations ['86119e93-90a6-4ee1-a09c-617a1b061741', '0334d273-c51c-47df-b533-93a092a013ef', 'e9c5799a-2206-4ee7-b04e-6fe7473708f7', '303eea81-7fb9-4cd0-b517-7214e0832048'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:21 devstack sudo[111632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:21 devstack sudo[111632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:21 devstack sudo[111632]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Deleted volume successfully.
Jun 24 04:32:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8a2b62a3-139c-4e8e-8851-d2b40cb919aa tempest-VolumesSnapshotListTestJSON-1735286446 None] Lock "cinder-d8013664-2690-4292-8ea0-a3dee0bbe9b3-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (1047a127-2696-476b-95ff-c4961474f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe81b62e-cf44-4a39-92a6-8247ed5efc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe81b62e-cf44-4a39-92a6-8247ed5efc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250789612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d50c6b-5629-41e6-87f7-8372ef4e9ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:25Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff2be68-011c-4e96-91e9-38356e9c5875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff2be68-011c-4e96-91e9-38356e9c5875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcca0ed-6c68-42e4-98fe-3e51d2c7185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcca0ed-6c68-42e4-98fe-3e51d2c7185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d50c6b-5629-41e6-87f7-8372ef4e9ecf', 'volume_name': 'volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13476d2-a209-43c7-bc53-2e2126793798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13476d2-a209-43c7-bc53-2e2126793798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6035369c-9077-4ff8-bde3-bace309d4614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:24 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume c0d50c6b-5629-41e6-87f7-8372ef4e9ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf', 'volume_size': 1}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250789612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d50c6b-5629-41e6-87f7-8372ef4e9ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:25Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Creating volume c0d50c6b-5629-41e6-87f7-8372ef4e9ecf {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:24 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:24 devstack sudo[111638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf 1073741824
Jun 24 04:32:24 devstack sudo[111638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:25 devstack sudo[111638]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf 1073741824" returned: 0 in 0.905s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:25 devstack sudo[111644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf
Jun 24 04:32:25 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (bbe74e6f-9052-44a5-b3ac-78ac361b2cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc08924a-b9bb-4476-86ae-ac14d60fdc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc08924a-b9bb-4476-86ae-ac14d60fdc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1583993479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:26Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ab5827-412d-4fec-834a-1e2953d562f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ab5827-412d-4fec-834a-1e2953d562f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece9318-3ad6-457d-97d3-1d947675d527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece9318-3ad6-457d-97d3-1d947675d527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6', 'volume_name': 'volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c4e2b5-f49c-44ab-992b-19c1175c98f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c4e2b5-f49c-44ab-992b-19c1175c98f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ddc263-48bd-42b1-88ff-3ff6433a4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Volume 5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6', 'volume_size': 1}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (461baf6c-4782-4915-bcb0-afc0e47a45ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8976fa4-93ac-4f28-91dd-c05728327134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8976fa4-93ac-4f28-91dd-c05728327134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931895031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f43dc72-bfeb-4a88-bdd9-1e9092c37847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:26Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e45d73-366f-40eb-ae19-8d79cf9f6d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e45d73-366f-40eb-ae19-8d79cf9f6d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f4d7fb-e30c-4f1f-989d-ffb88c43486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f4d7fb-e30c-4f1f-989d-ffb88c43486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f43dc72-bfeb-4a88-bdd9-1e9092c37847', 'volume_name': 'volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ed89ff-cd69-4e78-83a6-022c04e00b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ed89ff-cd69-4e78-83a6-022c04e00b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96005293-b470-4cee-800d-dd2970b71bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Volume 2f43dc72-bfeb-4a88-bdd9-1e9092c37847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847', 'volume_size': 1}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:26 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf" returned: 0 in 0.698s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1583993479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:26Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Creating volume 5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:26 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6035369c-9077-4ff8-bde3-bace309d4614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack sudo[111653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6 1073741824
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d711c8e-3baa-41f3-b9db-1328adb56aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf (c0d50c6b-5629-41e6-87f7-8372ef4e9ecf): created successfully
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d711c8e-3baa-41f3-b9db-1328adb56aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (1047a127-2696-476b-95ff-c4961474f965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-60627fd4-0feb-49ae-a7c2-45b2f8d85616 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created volume successfully.
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (1a5256a1-0e6c-4655-9d6d-c413bdeb148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b81d1ba-602a-431b-92c4-795cf283dd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b81d1ba-602a-431b-92c4-795cf283dd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952825495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee47f664-14d3-40f5-8a84-77d223c754bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:27Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5550559-f2bc-431b-92cc-3e59783f996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5550559-f2bc-431b-92cc-3e59783f996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f781a91-4611-4581-8d54-d59e80b8b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f781a91-4611-4581-8d54-d59e80b8b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee47f664-14d3-40f5-8a84-77d223c754bd', 'volume_name': 'volume-ee47f664-14d3-40f5-8a84-77d223c754bd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5d04ca-abe9-4908-b702-05f413dc5f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5d04ca-abe9-4908-b702-05f413dc5f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81318cf2-e5e2-448d-86c1-c429ced2250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Volume ee47f664-14d3-40f5-8a84-77d223c754bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee47f664-14d3-40f5-8a84-77d223c754bd', 'volume_size': 1}
Jun 24 04:32:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=64,cinder:UPDATE=62,cinder:INSERT=18,cinder:DELETE=5 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=66,cinder:UPDATE=74,cinder:INSERT=17,cinder:DELETE=4 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (68db9dd2-1fbd-4f72-86eb-5c9e7e6e75e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d20964e-3b1b-413a-8b31-4a106b4b7e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d20964e-3b1b-413a-8b31-4a106b4b7e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1483432720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9082206-b2fe-4a85-a064-578ecb2805d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:27Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26add2e-0dee-44a5-9982-19114d4f21b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26add2e-0dee-44a5-9982-19114d4f21b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fca1df1-776f-4214-bcec-a1bd7844042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fca1df1-776f-4214-bcec-a1bd7844042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9082206-b2fe-4a85-a064-578ecb2805d9', 'volume_name': 'volume-e9082206-b2fe-4a85-a064-578ecb2805d9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6c0ad3-c8b8-48eb-a00f-f2ede5166984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6c0ad3-c8b8-48eb-a00f-f2ede5166984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f6002c-0e1c-476f-8145-243fb3c8739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Volume e9082206-b2fe-4a85-a064-578ecb2805d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9082206-b2fe-4a85-a064-578ecb2805d9', 'volume_size': 1}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:27 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6 1073741824" returned: 0 in 1.100s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (0783c3ea-3772-46c9-b6f2-15eea760b9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0d669b-6467-4b6e-8170-1abffd50230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0d669b-6467-4b6e-8170-1abffd50230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1643981631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77b17ab-1882-4a10-b680-35c536a0e13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:28Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4183ebb2-070e-4886-99fe-5dceff97817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack sudo[111662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6
Jun 24 04:32:27 devstack sudo[111662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4183ebb2-070e-4886-99fe-5dceff97817a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce75b2da-141a-4614-afe7-3eb07e501396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce75b2da-141a-4614-afe7-3eb07e501396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77b17ab-1882-4a10-b680-35c536a0e13d', 'volume_name': 'volume-b77b17ab-1882-4a10-b680-35c536a0e13d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e72296-63fc-409a-88a3-2177d5deae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e72296-63fc-409a-88a3-2177d5deae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dce28cd-b529-4919-b449-95a6f4a39eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:27 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Volume b77b17ab-1882-4a10-b680-35c536a0e13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77b17ab-1882-4a10-b680-35c536a0e13d', 'volume_size': 1}
Jun 24 04:32:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (9a12d2e3-e21d-42c4-a46a-881c7fdb211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d012607-db80-43f6-a8a0-bc12da641698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d012607-db80-43f6-a8a0-bc12da641698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292046023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c663447-2f45-4f0e-b2d6-b1873b17ef5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:28Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c2c94e-037e-4f00-a21b-acd9a3b9e705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c2c94e-037e-4f00-a21b-acd9a3b9e705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1410d4b0-c9e1-4962-ba10-96c8ddf753f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1410d4b0-c9e1-4962-ba10-96c8ddf753f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c663447-2f45-4f0e-b2d6-b1873b17ef5c', 'volume_name': 'volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d08f46-fccc-4bf8-bdd4-107639ce71ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d08f46-fccc-4bf8-bdd4-107639ce71ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc3414c-29cb-4439-911f-44dbe6dc60a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume 0c663447-2f45-4f0e-b2d6-b1873b17ef5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c', 'volume_size': 1}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (2ba95bca-e7d9-432a-af9f-c8416b557a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d5d41c-d4b0-4b0a-886d-464a80602956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d5d41c-d4b0-4b0a-886d-464a80602956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-486847715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e442caa-b870-4745-8853-3904b8c32e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:28Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e90192-147f-4817-8de7-9ad88f2fc913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e90192-147f-4817-8de7-9ad88f2fc913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06974f1-0783-4735-99cb-6fcd568f71c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06974f1-0783-4735-99cb-6fcd568f71c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e442caa-b870-4745-8853-3904b8c32e9c', 'volume_name': 'volume-5e442caa-b870-4745-8853-3904b8c32e9c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0fbc4f-0e5c-45df-9140-9dbab27fd17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0fbc4f-0e5c-45df-9140-9dbab27fd17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91477516-320c-4b63-94e2-2171ffcfacb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume 5e442caa-b870-4745-8853-3904b8c32e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e442caa-b870-4745-8853-3904b8c32e9c', 'volume_size': 1}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (8ae1a8f3-d4a1-496b-8608-de3c0fcc217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a5d910-509b-4348-a5dc-5bf52dd372c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a5d910-509b-4348-a5dc-5bf52dd372c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033466383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75f3898-bd22-45b5-93d1-b0bd0dc921d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:28Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88284683-e6cb-4d2d-9868-1a15b5f1cb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88284683-e6cb-4d2d-9868-1a15b5f1cb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d881275b-bb9a-4967-871c-2acd793a4539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d881275b-bb9a-4967-871c-2acd793a4539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75f3898-bd22-45b5-93d1-b0bd0dc921d6', 'volume_name': 'volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e7ff1-f17f-42aa-b272-752c5c29c09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45e7ff1-f17f-42aa-b272-752c5c29c09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d15f7d-65f7-45a5-b7b9-d5c1dc6030fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume d75f3898-bd22-45b5-93d1-b0bd0dc921d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6', 'volume_size': 1}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:28 devstack sudo[111662]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6" returned: 0 in 0.871s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931895031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f43dc72-bfeb-4a88-bdd9-1e9092c37847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:26Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Creating volume 2f43dc72-bfeb-4a88-bdd9-1e9092c37847 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:28 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:28 devstack sudo[111666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847 1073741824
Jun 24 04:32:28 devstack sudo[111666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ddc263-48bd-42b1-88ff-3ff6433a4888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2109f6b-5509-462e-94ae-b2e01583f29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Volume volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6 (5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6): created successfully
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2109f6b-5509-462e-94ae-b2e01583f29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (bbe74e6f-9052-44a5-b3ac-78ac361b2cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:28 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-897c4f9f-3309-4b45-9469-67cfd39c4caa tempest-CreateVolumesFromImageTest-1453328356 None] Created volume successfully.
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (2eddeb1c-a1d7-44e7-b955-b6172ba85b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561b1044-5c6b-4e29-8210-2e785c5d0096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:28 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561b1044-5c6b-4e29-8210-2e785c5d0096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1096206535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2662a45d-cda7-4037-8839-2852fb58d613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:29Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffe0529-66a8-4b71-badd-108ae398c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffe0529-66a8-4b71-badd-108ae398c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adba960a-5666-4208-b258-cc18650580db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adba960a-5666-4208-b258-cc18650580db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2662a45d-cda7-4037-8839-2852fb58d613', 'volume_name': 'volume-2662a45d-cda7-4037-8839-2852fb58d613', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32078d7a-2f1c-4653-9019-bf6f6be557de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32078d7a-2f1c-4653-9019-bf6f6be557de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cb4fc9-ecdb-42dd-b1b0-a9135ea20cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume 2662a45d-cda7-4037-8839-2852fb58d613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2662a45d-cda7-4037-8839-2852fb58d613', 'volume_size': 1}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (57ec2c59-5511-4aef-ac45-61fd689ae55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2104cd46-76a2-4ebd-b4c9-9fa02bb42d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2104cd46-76a2-4ebd-b4c9-9fa02bb42d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1114140077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060a9c43-5d2a-48ca-a758-595884d57535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:29Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5ad51e-fd8b-4ef4-9a52-535327317463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5ad51e-fd8b-4ef4-9a52-535327317463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4a6926-bc8c-4152-9fe8-c1708370cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4a6926-bc8c-4152-9fe8-c1708370cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060a9c43-5d2a-48ca-a758-595884d57535', 'volume_name': 'volume-060a9c43-5d2a-48ca-a758-595884d57535', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d8480a-1a6e-4a89-ab06-aa2d561b9a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d8480a-1a6e-4a89-ab06-aa2d561b9a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369b6bd0-3461-4772-a4d0-8a9702e8c7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume 060a9c43-5d2a-48ca-a758-595884d57535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060a9c43-5d2a-48ca-a758-595884d57535', 'volume_size': 1}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:29 devstack sudo[111666]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847 1073741824" returned: 0 in 0.892s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:29 devstack sudo[111672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847
Jun 24 04:32:29 devstack sudo[111672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:30 devstack sudo[111672]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847" returned: 0 in 0.643s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.380s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952825495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee47f664-14d3-40f5-8a84-77d223c754bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:27Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Creating volume ee47f664-14d3-40f5-8a84-77d223c754bd {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:30 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96005293-b470-4cee-800d-dd2970b71bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb048575-4be4-4655-ba96-9ae47b693240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:30 devstack sudo[111675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd 1073741824
Jun 24 04:32:30 devstack sudo[111675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:30 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Volume volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847 (2f43dc72-bfeb-4a88-bdd9-1e9092c37847): created successfully
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb048575-4be4-4655-ba96-9ae47b693240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:30 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (461baf6c-4782-4915-bcb0-afc0e47a45ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:30 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-60e9ef90-b969-46b7-881b-4622ccdb2743 tempest-CreateVolumesFromImageTest-1453328356 None] Created volume successfully.
Jun 24 04:32:31 devstack sudo[111675]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd 1073741824" returned: 0 in 0.850s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:31 devstack sudo[111682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd
Jun 24 04:32:31 devstack sudo[111682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:31 devstack sudo[111682]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd" returned: 0 in 0.635s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.568s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1483432720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9082206-b2fe-4a85-a064-578ecb2805d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:27Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Creating volume e9082206-b2fe-4a85-a064-578ecb2805d9 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:31 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81318cf2-e5e2-448d-86c1-c429ced2250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee47f664-14d3-40f5-8a84-77d223c754bd', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:31 devstack sudo[111685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9 1073741824
Jun 24 04:32:31 devstack sudo[111685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711dfb47-57ec-4ee1-ae62-8a55798a2d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:31 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Volume volume-ee47f664-14d3-40f5-8a84-77d223c754bd (ee47f664-14d3-40f5-8a84-77d223c754bd): created successfully
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711dfb47-57ec-4ee1-ae62-8a55798a2d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:31 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (1a5256a1-0e6c-4655-9d6d-c413bdeb148a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:31 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d39eb587-4e2e-4a0b-9d6c-a4cfd18cb59b tempest-CreateVolumesFromImageTest-1453328356 None] Created volume successfully.
Jun 24 04:32:32 devstack sudo[111685]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9 1073741824" returned: 0 in 0.836s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:32 devstack sudo[111690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9
Jun 24 04:32:32 devstack sudo[111690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:33 devstack sudo[111690]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9" returned: 0 in 0.620s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.422s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1643981631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77b17ab-1882-4a10-b680-35c536a0e13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b448fd7616cc4b878464da53d6cefe01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:28Z,use_quota=True,user_id='b963b9784070465687962c8e1420d912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Creating volume b77b17ab-1882-4a10-b680-35c536a0e13d {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:33 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f6002c-0e1c-476f-8145-243fb3c8739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9082206-b2fe-4a85-a064-578ecb2805d9', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:33 devstack sudo[111695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d 1073741824
Jun 24 04:32:33 devstack sudo[111695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c29b52-f8da-4c7d-a4eb-951c78d174db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Volume volume-e9082206-b2fe-4a85-a064-578ecb2805d9 (e9082206-b2fe-4a85-a064-578ecb2805d9): created successfully
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c29b52-f8da-4c7d-a4eb-951c78d174db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (68db9dd2-1fbd-4f72-86eb-5c9e7e6e75e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:33 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a297cd4e-df02-4d20-b6d8-c20255ece443 tempest-CreateVolumesFromImageTest-1453328356 None] Created volume successfully.
Jun 24 04:32:34 devstack sudo[111695]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d 1073741824" returned: 0 in 0.795s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:34 devstack sudo[111701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d
Jun 24 04:32:34 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:34 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d" returned: 0 in 0.626s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.427s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292046023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c663447-2f45-4f0e-b2d6-b1873b17ef5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:28Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Creating volume 0c663447-2f45-4f0e-b2d6-b1873b17ef5c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:34 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dce28cd-b529-4919-b449-95a6f4a39eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77b17ab-1882-4a10-b680-35c536a0e13d', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:34 devstack sudo[111704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c 1073741824
Jun 24 04:32:34 devstack sudo[111704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91949ea-9c83-4d10-ad17-f449e9a4b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:34 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Volume volume-b77b17ab-1882-4a10-b680-35c536a0e13d (b77b17ab-1882-4a10-b680-35c536a0e13d): created successfully
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91949ea-9c83-4d10-ad17-f449e9a4b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:34 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Flow 'volume_create_manager' (0783c3ea-3772-46c9-b6f2-15eea760b9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ac8cf6ff-b6fd-4a0b-9a98-eca7759af374 tempest-CreateVolumesFromImageTest-1453328356 None] Created volume successfully.
Jun 24 04:32:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-b77b17ab-1882-4a10-b680-35c536a0e13d-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-b77b17ab-1882-4a10-b680-35c536a0e13d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-quobyte-b77b17ab-1882-4a10-b680-35c536a0e13d" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:35 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-b77b17ab-1882-4a10-b680-35c536a0e13d" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:35 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4521db7-36fa-45aa-ae9d-25e4ed36f79c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:35 devstack sudo[111708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d
Jun 24 04:32:35 devstack sudo[111708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:35 devstack sudo[111704]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c 1073741824" returned: 0 in 0.878s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:35 devstack sudo[111712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c
Jun 24 04:32:35 devstack sudo[111712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:36 devstack sudo[111708]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d" returned: 0 in 0.758s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:36 devstack sudo[111717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d
Jun 24 04:32:36 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:36 devstack sudo[111712]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c" returned: 0 in 0.677s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.929s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-486847715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e442caa-b870-4745-8853-3904b8c32e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:28Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Creating volume 5e442caa-b870-4745-8853-3904b8c32e9c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:36 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc3414c-29cb-4439-911f-44dbe6dc60a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:36 devstack sudo[111720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c 1073741824
Jun 24 04:32:36 devstack sudo[111720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d56ef76-d2ec-4eda-9d8d-2e8d6ac2630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:36 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c (0c663447-2f45-4f0e-b2d6-b1873b17ef5c): created successfully
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d56ef76-d2ec-4eda-9d8d-2e8d6ac2630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (9a12d2e3-e21d-42c4-a46a-881c7fdb211f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b8cad134-0925-401f-bd4f-d0deff707733 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created volume successfully.
Jun 24 04:32:36 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b77b17ab-1882-4a10-b680-35c536a0e13d" returned: 0 in 0.622s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-b77b17ab-1882-4a10-b680-35c536a0e13d" released by "delete_volume" :: held 1.431s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Created reservations ['1c7876de-2493-4c61-b5c5-8bb3ecdd2a50', 'ffe03fb1-c11f-4a34-9712-bda7ba16f583', '5333c590-8bcb-4f74-85c4-8d74fed5a770', '7198ce03-014b-49f5-86d5-2e8d17c19288'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:36 devstack sudo[111724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:36 devstack sudo[111724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:37 devstack sudo[111720]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c 1073741824" returned: 0 in 0.853s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:37 devstack sudo[111729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c
Jun 24 04:32:37 devstack sudo[111729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-e9082206-b2fe-4a85-a064-578ecb2805d9-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-e9082206-b2fe-4a85-a064-578ecb2805d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-quobyte-e9082206-b2fe-4a85-a064-578ecb2805d9" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-e9082206-b2fe-4a85-a064-578ecb2805d9" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[723f7195-1f72-476b-b838-0c08d03cded5]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:37 devstack sudo[111724]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.750s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Deleted volume successfully.
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1d8e6718-a5f3-43b6-817a-9e08f5d8b934 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-b77b17ab-1882-4a10-b680-35c536a0e13d-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:37 devstack sudo[111732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9
Jun 24 04:32:37 devstack sudo[111732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:37 devstack sudo[111729]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.349s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033466383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75f3898-bd22-45b5-93d1-b0bd0dc921d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:28Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Creating volume d75f3898-bd22-45b5-93d1-b0bd0dc921d6 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:37 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91477516-320c-4b63-94e2-2171ffcfacb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e442caa-b870-4745-8853-3904b8c32e9c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:37 devstack sudo[111735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6 1073741824
Jun 24 04:32:37 devstack sudo[111735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c54558-ab5e-472f-ba14-ebd7ff895618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume volume-5e442caa-b870-4745-8853-3904b8c32e9c (5e442caa-b870-4745-8853-3904b8c32e9c): created successfully
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c54558-ab5e-472f-ba14-ebd7ff895618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (2ba95bca-e7d9-432a-af9f-c8416b557a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-109e2644-fbcd-4475-ae66-be182d7f95a9 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created volume successfully.
Jun 24 04:32:38 devstack sudo[111732]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9" returned: 0 in 0.797s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:38 devstack sudo[111740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9
Jun 24 04:32:38 devstack sudo[111740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:38 devstack sudo[111735]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6 1073741824" returned: 0 in 0.832s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:38 devstack sudo[111746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6
Jun 24 04:32:38 devstack sudo[111746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:38 devstack sudo[111740]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-e9082206-b2fe-4a85-a064-578ecb2805d9" returned: 0 in 0.673s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-e9082206-b2fe-4a85-a064-578ecb2805d9" released by "delete_volume" :: held 1.532s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Created reservations ['1a76d56c-bded-4b20-9e85-5273856c238c', '1f43d38f-61df-4695-8119-9a8851862751', 'b714c3c3-5b16-4ed2-a2ce-0eb629d0adce', '2d588b8c-85c0-4b42-9fc2-4ec21a336361'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:39 devstack sudo[111749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:39 devstack sudo[111749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:39 devstack sudo[111746]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6" returned: 0 in 0.694s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.448s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1096206535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2662a45d-cda7-4037-8839-2852fb58d613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:29Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Creating volume 2662a45d-cda7-4037-8839-2852fb58d613 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:39 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:39 devstack sudo[111752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613 1073741824
Jun 24 04:32:39 devstack sudo[111752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d15f7d-65f7-45a5-b7b9-d5c1dc6030fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7fe522-a1c8-4670-b990-6a38d4fd0892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6 (d75f3898-bd22-45b5-93d1-b0bd0dc921d6): created successfully
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7fe522-a1c8-4670-b990-6a38d4fd0892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (8ae1a8f3-d4a1-496b-8608-de3c0fcc217c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-61e8ca36-b8f8-4027-a8c5-bdfc9d91cc57 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created volume successfully.
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-ee47f664-14d3-40f5-8a84-77d223c754bd-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-ee47f664-14d3-40f5-8a84-77d223c754bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-quobyte-ee47f664-14d3-40f5-8a84-77d223c754bd" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-ee47f664-14d3-40f5-8a84-77d223c754bd" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d61fe9-5555-4c09-bc90-46e5223a84c7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:39 devstack sudo[111749]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.685s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Deleted volume successfully.
Jun 24 04:32:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5630a865-5c8a-4a5a-9b41-e0a38750d3f8 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-e9082206-b2fe-4a85-a064-578ecb2805d9-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:39 devstack sudo[111755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd
Jun 24 04:32:39 devstack sudo[111755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:40 devstack sudo[111752]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613 1073741824" returned: 0 in 0.859s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:40 devstack sudo[111760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613
Jun 24 04:32:40 devstack sudo[111760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:40 devstack sudo[111755]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd" returned: 0 in 0.772s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:40 devstack sudo[111765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd
Jun 24 04:32:40 devstack sudo[111765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:41 devstack sudo[111760]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.675s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1114140077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060a9c43-5d2a-48ca-a758-595884d57535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d242dc9175be43788ba59754a00c1225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:29Z,use_quota=True,user_id='f3c233b639754980a00dda3cefd4b936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Creating volume 060a9c43-5d2a-48ca-a758-595884d57535 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:41 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:41 devstack sudo[111769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535 1073741824
Jun 24 04:32:41 devstack sudo[111769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cb4fc9-ecdb-42dd-b1b0-a9135ea20cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2662a45d-cda7-4037-8839-2852fb58d613', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e970e92-b677-4e45-9dfb-d075d7858121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume volume-2662a45d-cda7-4037-8839-2852fb58d613 (2662a45d-cda7-4037-8839-2852fb58d613): created successfully
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e970e92-b677-4e45-9dfb-d075d7858121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (2eddeb1c-a1d7-44e7-b955-b6172ba85b41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-13abc221-cd1b-425b-ae3e-5a6c46a7bd64 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created volume successfully.
Jun 24 04:32:41 devstack sudo[111765]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ee47f664-14d3-40f5-8a84-77d223c754bd" returned: 0 in 0.617s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-ee47f664-14d3-40f5-8a84-77d223c754bd" released by "delete_volume" :: held 1.431s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Created reservations ['f7b37b89-fe4b-4ee3-aa30-1188baa601cd', '4699fa64-bf57-4105-9083-6d07cf726e9e', 'a75935f6-ee6a-47fb-a41b-c54fd8b03d9e', 'a8e43d0e-28f7-4f02-9fa9-a1fd436f1ef4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:41 devstack sudo[111771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:41 devstack sudo[111771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:41 devstack sudo[111769]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535 1073741824" returned: 0 in 0.798s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:41 devstack sudo[111771]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.626s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-2f43dc72-bfeb-4a88-bdd9-1e9092c37847-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Deleted volume successfully.
Jun 24 04:32:41 devstack sudo[111777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535
Jun 24 04:32:41 devstack sudo[111777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-2f43dc72-bfeb-4a88-bdd9-1e9092c37847-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-30c6b605-a80d-42dc-9d78-e6ef7481a6f4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-ee47f664-14d3-40f5-8a84-77d223c754bd-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:41 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-quobyte-2f43dc72-bfeb-4a88-bdd9-1e9092c37847" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-2f43dc72-bfeb-4a88-bdd9-1e9092c37847" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00cc485-eb34-41fd-a7da-33281ed5e7b8]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:42 devstack sudo[111779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847
Jun 24 04:32:42 devstack sudo[111779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:42 devstack sudo[111777]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535" returned: 0 in 0.668s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369b6bd0-3461-4772-a4d0-8a9702e8c7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060a9c43-5d2a-48ca-a758-595884d57535', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70495b1e-6fe3-493f-a24f-c7eb0e3e2755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Volume volume-060a9c43-5d2a-48ca-a758-595884d57535 (060a9c43-5d2a-48ca-a758-595884d57535): created successfully
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70495b1e-6fe3-493f-a24f-c7eb0e3e2755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Flow 'volume_create_manager' (57ec2c59-5511-4aef-ac45-61fd689ae55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:42 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-19b952b0-3e1d-4a40-93c1-931e5904d845 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created volume successfully.
Jun 24 04:32:42 devstack sudo[111779]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847" returned: 0 in 0.731s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:42 devstack sudo[111785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847
Jun 24 04:32:42 devstack sudo[111785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-060a9c43-5d2a-48ca-a758-595884d57535-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-060a9c43-5d2a-48ca-a758-595884d57535-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-quobyte-060a9c43-5d2a-48ca-a758-595884d57535" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-060a9c43-5d2a-48ca-a758-595884d57535" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7382e559-4343-4d34-b6fa-59b4d824a7a7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:43 devstack sudo[111785]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2f43dc72-bfeb-4a88-bdd9-1e9092c37847" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-2f43dc72-bfeb-4a88-bdd9-1e9092c37847" released by "delete_volume" :: held 1.452s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Created reservations ['81782911-cfa6-4a2b-9dfd-068f3feefcc6', '39a9d22d-bc87-4250-8f85-303889465378', '49745598-b786-4660-be1f-5f0b66c6b8a3', 'a488d3ab-3cf8-43d4-8f2b-a79f7c9242a6'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:43 devstack sudo[111788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535
Jun 24 04:32:43 devstack sudo[111788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:43 devstack sudo[111790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:43 devstack sudo[111790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:44 devstack sudo[111790]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.617s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:44 devstack sudo[111788]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535" returned: 0 in 0.807s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Deleted volume successfully.
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "cinder-quobyte-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:44 devstack sudo[111796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535
Jun 24 04:32:44 devstack sudo[111796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-807e61ed-90f9-489b-984e-fb1578b87c97 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-2f43dc72-bfeb-4a88-bdd9-1e9092c37847-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[767de3f8-e8a0-4718-a6a8-928ea656572c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:44 devstack sudo[111798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6
Jun 24 04:32:44 devstack sudo[111798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:44 devstack sudo[111796]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-060a9c43-5d2a-48ca-a758-595884d57535" returned: 0 in 0.685s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-060a9c43-5d2a-48ca-a758-595884d57535" released by "delete_volume" :: held 1.544s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:44 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created reservations ['a7436432-e8ed-4bff-b538-2937b1585313', '217d00fc-2446-441c-9c0c-b8bed5f16ab3', '8ff233eb-0e1e-4232-9495-6685d2f5d6a3', '82257ef7-1c66-45d3-88d8-f66a8ef60b39'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:45 devstack sudo[111805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:45 devstack sudo[111805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:45 devstack sudo[111798]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6" returned: 0 in 0.767s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:45 devstack sudo[111807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6
Jun 24 04:32:45 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-2662a45d-cda7-4037-8839-2852fb58d613-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-2662a45d-cda7-4037-8839-2852fb58d613-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-quobyte-2662a45d-cda7-4037-8839-2852fb58d613" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-2662a45d-cda7-4037-8839-2852fb58d613" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e118ce27-b06e-43c6-b231-e15e7779ca6c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:45 devstack sudo[111805]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.651s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:45 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Deleted volume successfully.
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-41ec6c48-5b06-4986-a58b-08f321686f76 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-060a9c43-5d2a-48ca-a758-595884d57535-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:45 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6" returned: 0 in 0.683s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-quobyte-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6" released by "delete_volume" :: held 1.486s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:45 devstack sudo[111811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613
Jun 24 04:32:45 devstack sudo[111811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Created reservations ['cdaf966c-f52e-475d-b852-ab8bf180c311', '365a150b-138b-4f05-86b2-0e7d5d50269e', '4cbae2c5-82ac-4b18-ac28-292faa34dc98', 'cf0c2b05-aa91-4e5e-b55b-772364abf434'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:45 devstack sudo[111813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:45 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:46 devstack sudo[111811]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613" returned: 0 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:46 devstack sudo[111819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613
Jun 24 04:32:46 devstack sudo[111819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:46 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.647s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:46 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Deleted volume successfully.
Jun 24 04:32:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-48133e60-cfef-49c2-a86b-72cc8d1238c4 tempest-CreateVolumesFromImageTest-1453328356 None] Lock "cinder-5efd164e-1cfc-4da1-9a7a-5d0e91d13dc6-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:47 devstack sudo[111819]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-2662a45d-cda7-4037-8839-2852fb58d613" returned: 0 in 0.691s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-2662a45d-cda7-4037-8839-2852fb58d613" released by "delete_volume" :: held 1.509s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created reservations ['223d91da-0219-41e5-8504-a52e4b1d1b7a', '05071b68-0dd8-4b2a-9ea9-738a999d5354', 'd8954178-0eea-43c4-b700-c2774219c254', 'd0688d03-3380-4f2e-b0a5-c70b54e87eb1'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:47 devstack sudo[111822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:47 devstack sudo[111822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-d75f3898-bd22-45b5-93d1-b0bd0dc921d6-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-d75f3898-bd22-45b5-93d1-b0bd0dc921d6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-quobyte-d75f3898-bd22-45b5-93d1-b0bd0dc921d6" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-d75f3898-bd22-45b5-93d1-b0bd0dc921d6" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0eeab-b600-4057-9c57-8863d4c39063]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:48 devstack sudo[111822]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:48 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:48 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Deleted volume successfully.
Jun 24 04:32:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-5aa65459-9525-4ab8-87b7-3b8142317eab tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-2662a45d-cda7-4037-8839-2852fb58d613-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:48 devstack sudo[111826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6
Jun 24 04:32:48 devstack sudo[111826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:48 devstack sudo[111826]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6" returned: 0 in 0.810s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:48 devstack sudo[111832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6
Jun 24 04:32:48 devstack sudo[111832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:49 devstack sudo[111832]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d75f3898-bd22-45b5-93d1-b0bd0dc921d6" returned: 0 in 0.642s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-d75f3898-bd22-45b5-93d1-b0bd0dc921d6" released by "delete_volume" :: held 1.512s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created reservations ['d24ade16-5d75-42a5-aab8-763d8f37f8da', '2f715b81-8001-4ffc-b8f7-08e671029997', '89c7892e-b37f-4465-b628-49de11471b48', '8d58d063-78f8-48e8-8466-5df8751d7a0e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:49 devstack sudo[111835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:49 devstack sudo[111835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-5e442caa-b870-4745-8853-3904b8c32e9c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-5e442caa-b870-4745-8853-3904b8c32e9c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-quobyte-5e442caa-b870-4745-8853-3904b8c32e9c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-5e442caa-b870-4745-8853-3904b8c32e9c" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10c4087-6fdc-4665-a9e1-9c689e0276c9]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:50 devstack sudo[111835]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.645s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Deleted volume successfully.
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8fee1f96-fd35-4aa2-bcf6-fff853415b73 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-d75f3898-bd22-45b5-93d1-b0bd0dc921d6-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:50 devstack sudo[111838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c
Jun 24 04:32:50 devstack sudo[111838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:50 devstack sudo[111838]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c" returned: 0 in 0.774s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:51 devstack sudo[111843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c
Jun 24 04:32:51 devstack sudo[111843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:51 devstack sudo[111843]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5e442caa-b870-4745-8853-3904b8c32e9c" returned: 0 in 0.670s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-5e442caa-b870-4745-8853-3904b8c32e9c" released by "delete_volume" :: held 1.482s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created reservations ['0fa7bc29-6579-4f2d-bc95-082f7987ec7b', '8fd48515-d6c1-413d-b582-a2ac2f156104', 'ca843bee-4cae-4a1a-8f0c-f30b852d0f3f', '42881787-b5c8-4bc2-ad32-41a7575d59a9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:51 devstack sudo[111846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:51 devstack sudo[111846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-0c663447-2f45-4f0e-b2d6-b1873b17ef5c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-0c663447-2f45-4f0e-b2d6-b1873b17ef5c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-quobyte-0c663447-2f45-4f0e-b2d6-b1873b17ef5c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-0c663447-2f45-4f0e-b2d6-b1873b17ef5c" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d5fe88-82c4-47c5-966e-0a3f9681880d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:52 devstack sudo[111846]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.695s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Deleted volume successfully.
Jun 24 04:32:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9bb5b164-5f30-4e13-84d8-7a04f40b8821 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-5e442caa-b870-4745-8853-3904b8c32e9c-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:52 devstack sudo[111849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c
Jun 24 04:32:52 devstack sudo[111849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:53 devstack sudo[111849]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c" returned: 0 in 0.780s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:53 devstack sudo[111868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c
Jun 24 04:32:53 devstack sudo[111868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:53 devstack sudo[111868]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0c663447-2f45-4f0e-b2d6-b1873b17ef5c" returned: 0 in 0.662s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-0c663447-2f45-4f0e-b2d6-b1873b17ef5c" released by "delete_volume" :: held 1.480s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created reservations ['8de2620f-d288-43eb-8fb7-b77b9d44913f', '41657342-13e7-4e78-92bf-ca87b51bb5f8', '72a402c9-00f1-44b1-a2a7-2d589519689f', '0b0649c4-f88b-457f-a844-09695a73c3f9'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:54 devstack sudo[111893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:54 devstack sudo[111893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "cinder-quobyte-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:32:54 devstack sudo[111893]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.639s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Deleted volume successfully.
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-77d6b7a4-05dd-4819-a79f-16da260d7ef6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-0c663447-2f45-4f0e-b2d6-b1873b17ef5c-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[153f5712-d41a-4d0d-81df-f179684ae74a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:32:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:54 devstack sudo[111896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf
Jun 24 04:32:54 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:55 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf" returned: 0 in 0.722s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:55 devstack sudo[111902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf
Jun 24 04:32:55 devstack sudo[111902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:56 devstack sudo[111902]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf" returned: 0 in 0.630s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-quobyte-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf" released by "delete_volume" :: held 1.397s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Created reservations ['1c9971bb-cac4-4b85-be27-836f0aee3d91', '354a4c2d-c75a-44f1-a9e7-b3ec1fcd0951', 'ff9ceda0-156d-4bf1-86a9-a741af020eb4', 'a2f5a0e8-3941-4e04-a96c-9a5719445c47'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:56 devstack sudo[111905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:32:56 devstack sudo[111905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:32:56 devstack sudo[111905]: pam_unix(sudo:session): session closed for user root
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.631s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:32:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Deleted volume successfully.
Jun 24 04:32:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-791933e6-3811-4c60-98b6-1582cf6ef5f6 tempest-CreateVolumesFromSourceVolumeTest-10457302 None] Lock "cinder-c0d50c6b-5629-41e6-87f7-8372ef4e9ecf-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Flow 'volume_create_manager' (0574fecd-9132-4ea0-ac82-335639d80675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9cb463-b532-4961-8b3e-b11c1268ba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9cb463-b532-4961-8b3e-b11c1268ba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-550195007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be92d50f-804f-41cb-89b1-930273a2436b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2933d5fa39974ba39e5a6112f3d35466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:59Z,use_quota=True,user_id='1b172f362dce4a948646bb2ced9d4d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156cf995-0081-4c4b-994e-87bc55553a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156cf995-0081-4c4b-994e-87bc55553a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b42c66c-67e1-4956-869c-b7b61c4bd38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b42c66c-67e1-4956-869c-b7b61c4bd38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be92d50f-804f-41cb-89b1-930273a2436b', 'volume_name': 'volume-be92d50f-804f-41cb-89b1-930273a2436b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3683af-8fb5-45f2-9cd1-c1e34ad4f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3683af-8fb5-45f2-9cd1-c1e34ad4f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9706a0-ee4a-4d6f-8045-278d55d8494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:32:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Volume be92d50f-804f-41cb-89b1-930273a2436b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be92d50f-804f-41cb-89b1-930273a2436b', 'volume_size': 1}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-550195007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be92d50f-804f-41cb-89b1-930273a2436b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2933d5fa39974ba39e5a6112f3d35466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:32:59Z,use_quota=True,user_id='1b172f362dce4a948646bb2ced9d4d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Creating volume be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:32:59 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:32:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:32:59 devstack sudo[111908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b 1073741824
Jun 24 04:32:59 devstack sudo[111908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:00 devstack sudo[111908]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b 1073741824" returned: 0 in 0.788s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:00 devstack sudo[111913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b
Jun 24 04:33:00 devstack sudo[111913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:00 devstack sudo[111913]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b" returned: 0 in 0.618s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9706a0-ee4a-4d6f-8045-278d55d8494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be92d50f-804f-41cb-89b1-930273a2436b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0618b4b-3dc1-4fe9-b5a4-7fe2e1eae421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:00 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Volume volume-be92d50f-804f-41cb-89b1-930273a2436b (be92d50f-804f-41cb-89b1-930273a2436b): created successfully
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0618b4b-3dc1-4fe9-b5a4-7fe2e1eae421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:00 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Flow 'volume_create_manager' (0574fecd-9132-4ea0-ac82-335639d80675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:00 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2605a3b2-ced1-4550-84bb-7582e3ca7193 tempest-VolumeDependencyTests-1640528003 None] Created volume successfully.
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Creating offline snapshot 4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 of volume be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7dce0a-b28c-47c1-ae34-a5820eee8803]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:01 devstack sudo[111916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b
Jun 24 04:33:01 devstack sudo[111916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:01 devstack sudo[111918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:33:01 devstack sudo[111918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:02 devstack sudo[111916]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b" returned: 0 in 0.744s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:02 devstack sudo[111924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 1G
Jun 24 04:33:02 devstack sudo[111924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:02 devstack sudo[111918]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.630s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:33:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:33:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:33:03 devstack sudo[111924]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 1G" returned: 0 in 0.769s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be92d50f-804f-41cb-89b1-930273a2436b -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:03 devstack sudo[111930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be92d50f-804f-41cb-89b1-930273a2436b -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3
Jun 24 04:33:03 devstack sudo[111930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:03 devstack sudo[111930]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be92d50f-804f-41cb-89b1-930273a2436b -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" returned: 0 in 0.662s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:03 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 is being set with open permissions: ugo+rw
Jun 24 04:33:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:03 devstack sudo[111935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3
Jun 24 04:33:03 devstack sudo[111935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:04 devstack sudo[111935]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" returned: 0 in 0.613s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:04 devstack sudo[111938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.info
Jun 24 04:33:04 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:05 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.info" returned: 0 in 0.654s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:05 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.info is being set with open permissions: ugo+rw
Jun 24 04:33:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:05 devstack sudo[111942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.info
Jun 24 04:33:05 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:05 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.info" returned: 0 in 0.659s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-13928e52-676d-4a4e-8e2e-690815e87bc5 tempest-VolumeDependencyTests-1640528003 None] Create snapshot completed successfully
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Flow 'volume_create_manager' (18fa60be-e0ab-47ad-8b35-667756a1d3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6ee935-e4db-4938-bf58-2956607221f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6ee935-e4db-4938-bf58-2956607221f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2235900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5356d8-6ce4-4e31-9300-f64ca81ab1d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2933d5fa39974ba39e5a6112f3d35466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e5fe0e2-6777-49ca-a7c3-69d1fada45c3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:07Z,use_quota=True,user_id='1b172f362dce4a948646bb2ced9d4d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b589d1-7806-4896-a8d8-bc190ed1eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b589d1-7806-4896-a8d8-bc190ed1eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5cf370-ab51-460c-829d-f4b9ec55d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5cf370-ab51-460c-829d-f4b9ec55d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b5356d8-6ce4-4e31-9300-f64ca81ab1d7', 'volume_name': 'volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7', 'volume_size': 1, 'snapshot_id': '4e5fe0e2-6777-49ca-a7c3-69d1fada45c3'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d37d64-5211-4224-a145-0c0e522600c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d37d64-5211-4224-a145-0c0e522600c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8d757f-1a91-4693-8a42-13a2aa5c32ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Volume 0b5356d8-6ce4-4e31-9300-f64ca81ab1d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7', 'volume_size': 1, 'snapshot_id': '4e5fe0e2-6777-49ca-a7c3-69d1fada45c3'}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-quobyte-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Creating volume 0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 from snapshot 4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-quobyte-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] snapshot: 4e5fe0e2-6777-49ca-a7c3-69d1fada45c3, volume: 0b5356d8-6ce4-4e31-9300-f64ca81ab1d7,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[293789c6-7e60-48d2-923a-58d7eb878657]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:07 devstack sudo[111945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3
Jun 24 04:33:07 devstack sudo[111945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:08 devstack sudo[111945]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be92d50f-804f-41cb-89b1-930273a2436b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:33:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:33:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:33:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e076cd-cfff-4d27-961f-7a7b3efe1725]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:08 devstack sudo[111950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b
Jun 24 04:33:08 devstack sudo[111950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:09 devstack sudo[111950]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b" returned: 0 in 0.761s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:09 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:33:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:09 devstack sudo[111955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7
Jun 24 04:33:09 devstack sudo[111955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:13 devstack sudo[111955]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" returned: 0 in 4.360s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[557b4452-4e36-4246-b633-b47aa1bdbec1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:13 devstack sudo[111968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b
Jun 24 04:33:13 devstack sudo[111968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:14 devstack sudo[111968]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b" returned: 0 in 0.897s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:14 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:33:14 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Converted 1024.00 MB image at 234.80 MB/s
Jun 24 04:33:14 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 is being set with open permissions: ugo+rw
Jun 24 04:33:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:14 devstack sudo[111974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7
Jun 24 04:33:14 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:14 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" returned: 0 in 0.653s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" released by "_copy_volume_from_snapshot" :: held 7.524s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" released by "_create_volume_from_snapshot" :: held 7.550s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.564s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8d757f-1a91-4693-8a42-13a2aa5c32ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7', 'volume_size': 1, 'snapshot_id': '4e5fe0e2-6777-49ca-a7c3-69d1fada45c3'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6f34b9-8f5d-4370-bd27-d6b2cd5b7563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Volume volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 (0b5356d8-6ce4-4e31-9300-f64ca81ab1d7): created successfully
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6f34b9-8f5d-4370-bd27-d6b2cd5b7563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Flow 'volume_create_manager' (18fa60be-e0ab-47ad-8b35-667756a1d3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-00b86384-4cbf-404e-a2c9-a14f06e89cd1 tempest-VolumeDependencyTests-1640528003 None] Created volume successfully.
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-quobyte-be92d50f-804f-41cb-89b1-930273a2436b" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-be92d50f-804f-41cb-89b1-930273a2436b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-quobyte-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Deleting offline snapshot 4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 of volume be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] snapshot_file for this snap is: volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d184e22a-163a-48fe-a40a-bd0177bb13e0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:16 devstack sudo[111978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3
Jun 24 04:33:16 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:16 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" returned: 0 in 0.729s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be92d50f-804f-41cb-89b1-930273a2436b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:33:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[524101ec-9551-4e9f-905b-9a57ef2333b4]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:16 devstack sudo[111983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b
Jun 24 04:33:16 devstack sudo[111983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:17 devstack sudo[111983]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b" returned: 0 in 0.761s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:17 devstack sudo[111988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3
Jun 24 04:33:17 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:18 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" returned: 0 in 0.725s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:18 devstack sudo[111993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3
Jun 24 04:33:18 devstack sudo[111993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:18 devstack sudo[111993]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b.4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" returned: 0 in 0.640s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3" released by "_delete_snapshot" :: held 2.945s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-be92d50f-804f-41cb-89b1-930273a2436b" released by "delete_snapshot" :: held 2.969s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Created reservations ['ed5db10c-32bd-4e7e-a23c-86b0e51f36ca', '52687e34-d8fb-4c83-a515-f3ce620a08f5', '935669f9-c814-4d21-bcba-dcb8f212f237', '591992a1-7292-42c6-a032-8b73f501aeda'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:33:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Delete snapshot completed successfully.
Jun 24 04:33:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-1c281f79-162d-486a-ad5b-a5956d0b140d tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-4e5fe0e2-6777-49ca-a7c3-69d1fada45c3-delete_snapshot" released by "delete_snapshot" :: held 3.092s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-be92d50f-804f-41cb-89b1-930273a2436b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-be92d50f-804f-41cb-89b1-930273a2436b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-quobyte-be92d50f-804f-41cb-89b1-930273a2436b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-be92d50f-804f-41cb-89b1-930273a2436b" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[47274715-ebb0-4577-8947-f308fd54d433]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:19 devstack sudo[111996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b
Jun 24 04:33:19 devstack sudo[111996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:19 devstack sudo[111996]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b" returned: 0 in 0.727s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:19 devstack sudo[112001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b
Jun 24 04:33:19 devstack sudo[112001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:20 devstack sudo[112001]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-be92d50f-804f-41cb-89b1-930273a2436b" returned: 0 in 0.613s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-be92d50f-804f-41cb-89b1-930273a2436b" released by "delete_volume" :: held 1.392s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Created reservations ['fd602300-1b0a-4303-9acb-20662ebbd67c', 'c795fcd1-5fd0-4cc5-8ae8-dbd3d1865704', 'c7c4bc70-8911-4ae2-a87c-ae1356f87ae8', 'cd226732-10bd-46bf-9821-9ec012bfb739'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:20 devstack sudo[112004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:33:20 devstack sudo[112004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:21 devstack sudo[112004]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.660s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:21 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Deleted volume successfully.
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-26882d0f-e8a0-453f-9f6b-15c10657bf8e tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-be92d50f-804f-41cb-89b1-930273a2436b-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "cinder-quobyte-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d7adc3-9ebd-4823-8f27-c0100afd8382]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:21 devstack sudo[112007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7
Jun 24 04:33:21 devstack sudo[112007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:22 devstack sudo[112007]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" returned: 0 in 0.716s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:22 devstack sudo[112012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7
Jun 24 04:33:22 devstack sudo[112012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:22 devstack sudo[112012]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" returned: 0 in 0.614s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-quobyte-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7" released by "delete_volume" :: held 1.370s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Created reservations ['36b25db3-6b22-4906-a3b7-a5c911dd1c34', '4d14d64e-c791-4f45-a897-fc4e14c36e4e', '6a7e5436-89f2-471c-a5dd-520154d88db1', '5b2358d2-819a-4e6c-8b43-f941aa0ce203'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:22 devstack sudo[112015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:33:22 devstack sudo[112015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:23 devstack sudo[112015]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.613s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:23 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:23 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Deleted volume successfully.
Jun 24 04:33:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-02c8cf21-0778-4ab1-a7b1-c7246a3dce3c tempest-VolumeDependencyTests-1640528003 None] Lock "cinder-0b5356d8-6ce4-4e31-9300-f64ca81ab1d7-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:32 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=92,cinder:UPDATE=156,cinder:DELETE=12,cinder:INSERT=33 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:33:33 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=99,cinder:UPDATE=133,cinder:INSERT=35,cinder:DELETE=14 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (edc9563f-8000-4c57-8b8f-2a07ed4153c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59738811-53cc-4c51-8e95-2c27d5274b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59738811-53cc-4c51-8e95-2c27d5274b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875798274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f875e2-eec4-4217-a791-047989c02c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:36Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda34f2c-9e99-461b-8cb3-827a72f5bbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda34f2c-9e99-461b-8cb3-827a72f5bbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c1f6c0-123b-464f-b18a-01511a53e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c1f6c0-123b-464f-b18a-01511a53e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f875e2-eec4-4217-a791-047989c02c6e', 'volume_name': 'volume-d9f875e2-eec4-4217-a791-047989c02c6e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c4537-7985-4728-9899-9827a638dff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c4537-7985-4728-9899-9827a638dff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50544b74-c3fe-4a11-84e1-4721c249df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:35 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Volume d9f875e2-eec4-4217-a791-047989c02c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f875e2-eec4-4217-a791-047989c02c6e', 'volume_size': 1}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875798274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f875e2-eec4-4217-a791-047989c02c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:36Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Creating volume d9f875e2-eec4-4217-a791-047989c02c6e {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:35 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:35 devstack sudo[112068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e 1073741824
Jun 24 04:33:35 devstack sudo[112068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (d32e06c6-5320-40ae-8c39-b779ea41d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:35 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18a2880-dbbd-49af-b5bd-04631d805f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18a2880-dbbd-49af-b5bd-04631d805f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590622696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:36Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fd093c-0778-495e-ab45-38a07a479523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fd093c-0778-495e-ab45-38a07a479523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1280dca2-f284-4d73-a16a-c567c7c44296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1280dca2-f284-4d73-a16a-c567c7c44296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353', 'volume_name': 'volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db8a996-f172-4032-b56c-f4878312cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db8a996-f172-4032-b56c-f4878312cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06660cdf-d408-47be-ba9b-9e7a03c2facf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume 848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353', 'volume_size': 1}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (6dae8dae-6060-4939-b811-efae569022d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce18d42-dab2-48cb-9d33-3cbc56d834bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce18d42-dab2-48cb-9d33-3cbc56d834bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230262712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73cef36-8002-4248-b64b-37064fb28415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:36Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776c4a49-6c46-4767-93cb-66b1fc7aea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776c4a49-6c46-4767-93cb-66b1fc7aea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c423f37-4e32-4579-a500-73a22738731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c423f37-4e32-4579-a500-73a22738731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a73cef36-8002-4248-b64b-37064fb28415', 'volume_name': 'volume-a73cef36-8002-4248-b64b-37064fb28415', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dde015-0ce8-4a5b-a91a-4bbb06531ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dde015-0ce8-4a5b-a91a-4bbb06531ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014cd539-0f19-4d17-8764-08a67c2422b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Volume a73cef36-8002-4248-b64b-37064fb28415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a73cef36-8002-4248-b64b-37064fb28415', 'volume_size': 1}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (fc9f36a8-d01d-4ca2-9fe5-6fbeb989c05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78ffcf0-5b4c-4e4e-a83e-6aeb4b5a6d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78ffcf0-5b4c-4e4e-a83e-6aeb4b5a6d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-764258344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9882313-f404-4b22-9d27-066775360b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:37Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c0c815-7879-4a41-ac44-01fdf5376159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c0c815-7879-4a41-ac44-01fdf5376159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76ae6b0-dac0-4525-b702-833fcb612e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76ae6b0-dac0-4525-b702-833fcb612e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9882313-f404-4b22-9d27-066775360b0b', 'volume_name': 'volume-d9882313-f404-4b22-9d27-066775360b0b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ef1252-d774-4766-96f1-7d7de436f191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ef1252-d774-4766-96f1-7d7de436f191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcc0c9a-bcba-4a9a-9e20-87eb645b31fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:36 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Volume d9882313-f404-4b22-9d27-066775360b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9882313-f404-4b22-9d27-066775360b0b', 'volume_size': 1}
Jun 24 04:33:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:37 devstack sudo[112068]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e 1073741824" returned: 0 in 1.191s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:37 devstack sudo[112075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e
Jun 24 04:33:37 devstack sudo[112075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (3b775a53-fa6c-4370-b330-32b88188b1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c88fa0-3d30-4a79-879f-7a50c7f4ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c88fa0-3d30-4a79-879f-7a50c7f4ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1193761282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca94576e-8860-4e07-b8db-78814314ee9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:37Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48275a68-2838-4ff5-b78b-1615a965a8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48275a68-2838-4ff5-b78b-1615a965a8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b324ebed-341a-49e3-95d4-7708cfe1fbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b324ebed-341a-49e3-95d4-7708cfe1fbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca94576e-8860-4e07-b8db-78814314ee9e', 'volume_name': 'volume-ca94576e-8860-4e07-b8db-78814314ee9e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a9cc4f-7b5d-43de-85ae-51885dec0f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a9cc4f-7b5d-43de-85ae-51885dec0f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c48498-fcb7-4ea5-ac69-32d78888d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume ca94576e-8860-4e07-b8db-78814314ee9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca94576e-8860-4e07-b8db-78814314ee9e', 'volume_size': 1}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (95f5893f-841b-44be-9003-dab3fc81d1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb921cb5-5b0c-40bb-968a-f8dae79e2559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb921cb5-5b0c-40bb-968a-f8dae79e2559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1163148097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714b1354-8eeb-4303-8a6f-88ff4ee64605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:37Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0215cb-4532-4650-beba-6f959af84351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0215cb-4532-4650-beba-6f959af84351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485c56c0-3dca-48ee-ac0d-1e6a664ca4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485c56c0-3dca-48ee-ac0d-1e6a664ca4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714b1354-8eeb-4303-8a6f-88ff4ee64605', 'volume_name': 'volume-714b1354-8eeb-4303-8a6f-88ff4ee64605', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf000db-5627-4075-a548-3759ccb489a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf000db-5627-4075-a548-3759ccb489a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f0112f-bb7e-48d6-81fc-963e3351cf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Volume 714b1354-8eeb-4303-8a6f-88ff4ee64605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714b1354-8eeb-4303-8a6f-88ff4ee64605', 'volume_size': 1}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (dd5da478-e932-4267-9473-6081f64e648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a98dd1-631d-4872-9d85-e5978d4082c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a98dd1-631d-4872-9d85-e5978d4082c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428227984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85353dd1-256a-43a6-a867-6d4eb89305df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:38Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97835422-9c58-4845-a97a-408a2a0500a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97835422-9c58-4845-a97a-408a2a0500a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c8b35a-2c0d-460e-b12a-7f06b1db83db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c8b35a-2c0d-460e-b12a-7f06b1db83db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85353dd1-256a-43a6-a867-6d4eb89305df', 'volume_name': 'volume-85353dd1-256a-43a6-a867-6d4eb89305df', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55fb862-93a8-4ba9-b6e9-a4acee80963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55fb862-93a8-4ba9-b6e9-a4acee80963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf1b3a1-d4ef-44eb-8a1d-084270676cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Volume 85353dd1-256a-43a6-a867-6d4eb89305df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85353dd1-256a-43a6-a867-6d4eb89305df', 'volume_size': 1}
Jun 24 04:33:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:38 devstack sudo[112075]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e" returned: 0 in 0.887s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590622696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:36Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Creating volume 848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:38 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:38 devstack sudo[112079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 1073741824
Jun 24 04:33:38 devstack sudo[112079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50544b74-c3fe-4a11-84e1-4721c249df0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f875e2-eec4-4217-a791-047989c02c6e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6208ad-8b6a-4128-88a6-5e08d835c8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:38 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Volume volume-d9f875e2-eec4-4217-a791-047989c02c6e (d9f875e2-eec4-4217-a791-047989c02c6e): created successfully
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6208ad-8b6a-4128-88a6-5e08d835c8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (edc9563f-8000-4c57-8b8f-2a07ed4153c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3009e229-ffb3-4ede-925f-c781645f4ee4 tempest-CreateVolumesFromImageTest-295976907 None] Created volume successfully.
Jun 24 04:33:38 devstack sudo[112079]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 1073741824" returned: 0 in 0.906s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:38 devstack sudo[112085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353
Jun 24 04:33:38 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:39 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" returned: 0 in 0.676s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.323s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230262712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73cef36-8002-4248-b64b-37064fb28415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:36Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Creating volume a73cef36-8002-4248-b64b-37064fb28415 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:39 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:39 devstack sudo[112088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415 1073741824
Jun 24 04:33:39 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06660cdf-d408-47be-ba9b-9e7a03c2facf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72df4b02-372f-4cfe-8b55-c9961299f234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:39 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 (848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353): created successfully
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72df4b02-372f-4cfe-8b55-c9961299f234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:39 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (d32e06c6-5320-40ae-8c39-b779ea41d721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2194c689-96ee-4fa6-a363-a11075d51238 tempest-CreateVolumesFromSnapshotTest-534288489 None] Created volume successfully.
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Flow 'volume_create_manager' (96dd46e3-0959-42a7-a2d8-3173ef21b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b69b3f-e3df-419a-9fde-00e913239472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b69b3f-e3df-419a-9fde-00e913239472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73b70d8-2eec-40df-9d5d-5511f6da8ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271db272cd6744408ce18256cacc091a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:40Z,use_quota=True,user_id='6c9270c88160471fa45896d0d9eb1426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a3f210-36a9-4ab4-b91b-2165d7b3128a),volume_type_id=72a3f210-36a9-4ab4-b91b-2165d7b3128a)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605f5bcf-15fd-478d-99e2-aea23ed74ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605f5bcf-15fd-478d-99e2-aea23ed74ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e3761f-149f-471d-9e00-6af41c9a763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e3761f-149f-471d-9e00-6af41c9a763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b73b70d8-2eec-40df-9d5d-5511f6da8ff4', 'volume_name': 'volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4', 'volume_size': 1, 'image_id': '95b857d0-2b27-413f-b2f7-7fe41098c850', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95b857d0-2b27-413f-b2f7-7fe41098c850', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1830e4602786e0c447e380f5f327117b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271db272cd6744408ce18256cacc091a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bdbd2f52ac0db996c403fdfeb37d7d882712641e6b9ba63ff16dd205afd56cecfc69c00cbe21fc1f3bcf88f11d9869f124dfc077a94eb0800dda256d29b8ae2', 'id': '95b857d0-2b27-413f-b2f7-7fe41098c850', 'created_at': datetime.datetime(2026, 6, 24, 2, 33, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 33, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95b857d0-2b27-413f-b2f7-7fe41098c850/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9e62b9af0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:40 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e0d120-f54b-4c2e-9951-8264d5d0cbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e0d120-f54b-4c2e-9951-8264d5d0cbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0271e853-bc53-4bbd-9967-35e2e095f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:40 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Volume b73b70d8-2eec-40df-9d5d-5511f6da8ff4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4', 'volume_size': 1, 'image_id': '95b857d0-2b27-413f-b2f7-7fe41098c850', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95b857d0-2b27-413f-b2f7-7fe41098c850', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1830e4602786e0c447e380f5f327117b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271db272cd6744408ce18256cacc091a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bdbd2f52ac0db996c403fdfeb37d7d882712641e6b9ba63ff16dd205afd56cecfc69c00cbe21fc1f3bcf88f11d9869f124dfc077a94eb0800dda256d29b8ae2', 'id': '95b857d0-2b27-413f-b2f7-7fe41098c850', 'created_at': datetime.datetime(2026, 6, 24, 2, 33, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 33, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95b857d0-2b27-413f-b2f7-7fe41098c850/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9e62b9af0>}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Trying to clone b73b70d8-2eec-40df-9d5d-5511f6da8ff4 from image 95b857d0-2b27-413f-b2f7-7fe41098c850 at location (None, [{'url': 'file:///opt/stack/data/glance/images/95b857d0-2b27-413f-b2f7-7fe41098c850', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415 1073741824" returned: 0 in 0.978s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:40 devstack sudo[112094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415
Jun 24 04:33:40 devstack sudo[112094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:33:40 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Image download 0.00 MB at 0.00 MB/s
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f84039-d98f-46e8-8d3e-6220ca9a53f4]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:40 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:40 devstack sudo[112096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD
Jun 24 04:33:40 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:41 devstack sudo[112094]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415" returned: 0 in 0.678s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.506s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-764258344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9882313-f404-4b22-9d27-066775360b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:37Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Creating volume d9882313-f404-4b22-9d27-066775360b0b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:41 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014cd539-0f19-4d17-8764-08a67c2422b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73cef36-8002-4248-b64b-37064fb28415', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:41 devstack sudo[112099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b 1073741824
Jun 24 04:33:41 devstack sudo[112099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddf1140-9404-4fc1-8dd5-caf5fcef6f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:41 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Volume volume-a73cef36-8002-4248-b64b-37064fb28415 (a73cef36-8002-4248-b64b-37064fb28415): created successfully
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddf1140-9404-4fc1-8dd5-caf5fcef6f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (6dae8dae-6060-4939-b811-efae569022d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:41 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ee349137-8933-4209-950c-753b1ac4a2d1 tempest-CreateVolumesFromImageTest-295976907 None] Created volume successfully.
Jun 24 04:33:41 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:41 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:41 devstack sudo[112103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD
Jun 24 04:33:41 devstack sudo[112103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:42 devstack sudo[112099]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b 1073741824" returned: 0 in 0.832s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:42 devstack sudo[112111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b
Jun 24 04:33:42 devstack sudo[112111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:42 devstack sudo[112103]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Temporary image 95b857d0-2b27-413f-b2f7-7fe41098c850 is fetched for user 6c9270c88160471fa45896d0d9eb1426. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7f5d44-e0a3-412a-bb96-1210abd93bfe]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:42 devstack sudo[112113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD
Jun 24 04:33:42 devstack sudo[112113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:42 devstack sudo[112111]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b" returned: 0 in 0.641s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.484s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1193761282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca94576e-8860-4e07-b8db-78814314ee9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:37Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Creating volume ca94576e-8860-4e07-b8db-78814314ee9e {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:42 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:42 devstack sudo[112116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e 1073741824
Jun 24 04:33:42 devstack sudo[112116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcc0c9a-bcba-4a9a-9e20-87eb645b31fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9882313-f404-4b22-9d27-066775360b0b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f43240-7015-40f6-9161-cebd9cd2e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:42 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Volume volume-d9882313-f404-4b22-9d27-066775360b0b (d9882313-f404-4b22-9d27-066775360b0b): created successfully
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f43240-7015-40f6-9161-cebd9cd2e902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:42 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (fc9f36a8-d01d-4ca2-9fe5-6fbeb989c05c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:43 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0ea48f4d-5233-483d-a1e5-d8349f3b5456 tempest-CreateVolumesFromImageTest-295976907 None] Created volume successfully.
Jun 24 04:33:43 devstack sudo[112113]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:43 devstack sudo[112120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD
Jun 24 04:33:43 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:43 devstack sudo[112116]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e 1073741824" returned: 0 in 0.841s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:43 devstack sudo[112126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e
Jun 24 04:33:43 devstack sudo[112126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:43 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD" returned: 1 in 0.726s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:33:43 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:44 devstack sudo[112126]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e" returned: 0 in 0.640s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.922s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1163148097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714b1354-8eeb-4303-8a6f-88ff4ee64605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:37Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Creating volume 714b1354-8eeb-4303-8a6f-88ff4ee64605 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:44 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c48498-fcb7-4ea5-ac69-32d78888d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca94576e-8860-4e07-b8db-78814314ee9e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:44 devstack sudo[112132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605 1073741824
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39677eca-714e-492f-a5c3-afd8dba79e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:44 devstack sudo[112132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:44 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume volume-ca94576e-8860-4e07-b8db-78814314ee9e (ca94576e-8860-4e07-b8db-78814314ee9e): created successfully
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39677eca-714e-492f-a5c3-afd8dba79e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:44 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (3b775a53-fa6c-4370-b330-32b88188b1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:44 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7ea33453-af09-41b7-b138-f58f0c916cc6 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created volume successfully.
Jun 24 04:33:45 devstack sudo[112132]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605 1073741824" returned: 0 in 0.828s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:45 devstack sudo[112139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605
Jun 24 04:33:45 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (efdf86e7-9878-4ec2-8f59-9b16ca965b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be65c22-1acf-469a-886e-2eadf03af6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be65c22-1acf-469a-886e-2eadf03af6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693753195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8233a829-6ecb-42fc-8c39-e4df851db14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:46Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caff3d0-8437-4dc0-9ea2-9a6f4c7af1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caff3d0-8437-4dc0-9ea2-9a6f4c7af1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc730d9d-2606-4512-ab5f-a9dbf8245fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc730d9d-2606-4512-ab5f-a9dbf8245fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8233a829-6ecb-42fc-8c39-e4df851db14f', 'volume_name': 'volume-8233a829-6ecb-42fc-8c39-e4df851db14f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e99609a-4491-4f33-beed-656ead13adea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e99609a-4491-4f33-beed-656ead13adea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65f67df-2c20-4d1b-b0d9-5f21d749a6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume 8233a829-6ecb-42fc-8c39-e4df851db14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8233a829-6ecb-42fc-8c39-e4df851db14f', 'volume_size': 1}
Jun 24 04:33:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:46 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605" returned: 0 in 0.715s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.286s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1428227984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85353dd1-256a-43a6-a867-6d4eb89305df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3d8438087490b8e9f81486b97a5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:38Z,use_quota=True,user_id='56cd33053ecb448d8a2a982e1c1f4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Creating volume 85353dd1-256a-43a6-a867-6d4eb89305df {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:46 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:46 devstack sudo[112142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df 1073741824
Jun 24 04:33:46 devstack sudo[112142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f0112f-bb7e-48d6-81fc-963e3351cf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714b1354-8eeb-4303-8a6f-88ff4ee64605', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7cf881-04a5-4ec8-a13b-fd65a06aa962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (d3448100-4e23-45bf-9cbf-ed539b1453fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0204545-bac3-4f49-9d68-ac675abdca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Volume volume-714b1354-8eeb-4303-8a6f-88ff4ee64605 (714b1354-8eeb-4303-8a6f-88ff4ee64605): created successfully
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7cf881-04a5-4ec8-a13b-fd65a06aa962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (95f5893f-841b-44be-9003-dab3fc81d1f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0204545-bac3-4f49-9d68-ac675abdca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559250037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99d71d0-2c4f-454b-b466-7746d04749c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:46Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971dd6b8-b7ae-4129-8ce5-fb6ccbf8f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971dd6b8-b7ae-4129-8ce5-fb6ccbf8f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f447bf0b-d416-4ed3-bdf3-1c007241e29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f447bf0b-d416-4ed3-bdf3-1c007241e29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a99d71d0-2c4f-454b-b466-7746d04749c5', 'volume_name': 'volume-a99d71d0-2c4f-454b-b466-7746d04749c5', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb69bd1b-92cf-4166-9b3e-ad0a3ae9b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb69bd1b-92cf-4166-9b3e-ad0a3ae9b032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf5fd30-55b3-4a4a-9876-163b36750eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume a99d71d0-2c4f-454b-b466-7746d04749c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a99d71d0-2c4f-454b-b466-7746d04749c5', 'volume_size': 1}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2deff5a8-05fd-410a-b50b-2e72872fdd58 tempest-CreateVolumesFromImageTest-295976907 None] Created volume successfully.
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (32b8b8a2-fe05-4f4f-8e05-39434b13ddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759635b8-e0a9-40c7-902f-d4a224947573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759635b8-e0a9-40c7-902f-d4a224947573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-819848591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430f64fa-b56b-457c-ab24-2eb5054c1c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:46Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25b1448-0546-4e85-b9ac-a9f3da8132fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25b1448-0546-4e85-b9ac-a9f3da8132fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bdb738-bb7a-4cad-9494-95952b769e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bdb738-bb7a-4cad-9494-95952b769e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430f64fa-b56b-457c-ab24-2eb5054c1c26', 'volume_name': 'volume-430f64fa-b56b-457c-ab24-2eb5054c1c26', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84af5931-dc90-44a6-855a-51f6343491c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84af5931-dc90-44a6-855a-51f6343491c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49f81bf-b6b3-4aec-b07d-1c2f0a757394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume 430f64fa-b56b-457c-ab24-2eb5054c1c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430f64fa-b56b-457c-ab24-2eb5054c1c26', 'volume_size': 1}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (56959e53-be08-456a-bc5d-4209320ac3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5296fd-2811-4f59-a7c8-9dd8e53ed59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5296fd-2811-4f59-a7c8-9dd8e53ed59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-111334783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62295c8-5149-4a0e-bd57-30cc1678404c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:47Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dff7dd-ef86-4052-b3a9-feed8dddb037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dff7dd-ef86-4052-b3a9-feed8dddb037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef496cb-3352-442a-9506-9cd13ad252b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef496cb-3352-442a-9506-9cd13ad252b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62295c8-5149-4a0e-bd57-30cc1678404c', 'volume_name': 'volume-a62295c8-5149-4a0e-bd57-30cc1678404c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ece5b9-2acf-4497-ba8e-248330cb0c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ece5b9-2acf-4497-ba8e-248330cb0c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1a2087-9452-49a6-85e7-0d95c8534305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume a62295c8-5149-4a0e-bd57-30cc1678404c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62295c8-5149-4a0e-bd57-30cc1678404c', 'volume_size': 1}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:47 devstack sudo[112142]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df 1073741824" returned: 0 in 0.973s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:47 devstack sudo[112149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df
Jun 24 04:33:47 devstack sudo[112149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (bda96ec8-8dcd-45da-bafa-c087ea63b397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0111689-bcec-4156-8644-abe6ac7bf60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0111689-bcec-4156-8644-abe6ac7bf60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1718026575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429ce8b7-382b-4aea-9243-53e904ac2044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:47Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6db2b02-56a2-48a0-966d-b6f69360eb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6db2b02-56a2-48a0-966d-b6f69360eb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aff5c4d-dc2d-4078-ba90-cdb6fda057df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aff5c4d-dc2d-4078-ba90-cdb6fda057df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429ce8b7-382b-4aea-9243-53e904ac2044', 'volume_name': 'volume-429ce8b7-382b-4aea-9243-53e904ac2044', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1032998-b1ed-4dba-a7e0-94ef56d21e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1032998-b1ed-4dba-a7e0-94ef56d21e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc7b0e8-4714-4e13-a219-f03b6a4f74dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume 429ce8b7-382b-4aea-9243-53e904ac2044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429ce8b7-382b-4aea-9243-53e904ac2044', 'volume_size': 1}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:47 devstack sudo[112149]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df" returned: 0 in 0.718s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.308s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Creating offline snapshot 1be6590f-4e26-4150-8f72-87ea5249bfdd of volume 848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf1b3a1-d4ef-44eb-8a1d-084270676cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85353dd1-256a-43a6-a867-6d4eb89305df', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d5aeb0-7e55-41ff-9fe4-b574ee493431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a3dcd-feaf-4992-a26f-66faaad3bea7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:47 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Volume volume-85353dd1-256a-43a6-a867-6d4eb89305df (85353dd1-256a-43a6-a867-6d4eb89305df): created successfully
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d5aeb0-7e55-41ff-9fe4-b574ee493431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:47 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Flow 'volume_create_manager' (dd5da478-e932-4267-9473-6081f64e648f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:47 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-129394d1-4da0-4fd5-8e0a-3e8da22ef602 tempest-CreateVolumesFromImageTest-295976907 None] Created volume successfully.
Jun 24 04:33:47 devstack sudo[112152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353
Jun 24 04:33:47 devstack sudo[112152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-85353dd1-256a-43a6-a867-6d4eb89305df-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-85353dd1-256a-43a6-a867-6d4eb89305df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-quobyte-85353dd1-256a-43a6-a867-6d4eb89305df" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:48 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-85353dd1-256a-43a6-a867-6d4eb89305df" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb4e30-f205-4e92-be8e-24c8bdb626c1]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:48 devstack sudo[112152]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" returned: 0 in 0.852s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:48 devstack sudo[112157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df
Jun 24 04:33:48 devstack sudo[112157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:48 devstack sudo[112159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd 1G
Jun 24 04:33:48 devstack sudo[112159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:49 devstack sudo[112157]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df" returned: 0 in 0.800s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:49 devstack sudo[112168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df
Jun 24 04:33:49 devstack sudo[112168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:49 devstack sudo[112159]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd 1G" returned: 0 in 0.821s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:49 devstack sudo[112170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd
Jun 24 04:33:49 devstack sudo[112170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:50 devstack sudo[112168]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-85353dd1-256a-43a6-a867-6d4eb89305df" returned: 0 in 0.659s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-85353dd1-256a-43a6-a867-6d4eb89305df" released by "delete_volume" :: held 1.501s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Created reservations ['1d94febc-01be-4780-b48a-13e707652000', '576b7743-cc45-4c41-8b33-88e3f824f1b9', 'fb30abef-6f23-45f2-86d5-ea4bb994479f', '500e52c6-6ee9-4827-b9ba-8b99358ec9f7'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:50 devstack sudo[112176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:33:50 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:50 devstack sudo[112170]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd" returned: 0 in 0.726s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:50 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd is being set with open permissions: ugo+rw
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:50 devstack sudo[112178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd
Jun 24 04:33:50 devstack sudo[112178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-714b1354-8eeb-4303-8a6f-88ff4ee64605-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-714b1354-8eeb-4303-8a6f-88ff4ee64605-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-quobyte-714b1354-8eeb-4303-8a6f-88ff4ee64605" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-714b1354-8eeb-4303-8a6f-88ff4ee64605" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[117c27c0-0e99-402c-baf2-33393b19a6f7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:50 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.711s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Deleted volume successfully.
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a6d8b8bd-5b16-4b3f-8d26-d5c85679b705 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-85353dd1-256a-43a6-a867-6d4eb89305df-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:50 devstack sudo[112178]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd" returned: 0 in 0.730s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:50 devstack sudo[112182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605
Jun 24 04:33:50 devstack sudo[112182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:51 devstack sudo[112184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.info
Jun 24 04:33:51 devstack sudo[112184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:51 devstack sudo[112184]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.info" returned: 0 in 0.643s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:51 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.info is being set with open permissions: ugo+rw
Jun 24 04:33:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:51 devstack sudo[112191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.info
Jun 24 04:33:51 devstack sudo[112191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:51 devstack sudo[112182]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605" returned: 0 in 0.816s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:51 devstack sudo[112193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605
Jun 24 04:33:51 devstack sudo[112193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:52 devstack sudo[112193]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:52 devstack sudo[112191]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-714b1354-8eeb-4303-8a6f-88ff4ee64605" returned: 0 in 0.642s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.info" returned: 0 in 0.685s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.557s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-714b1354-8eeb-4303-8a6f-88ff4ee64605" released by "delete_volume" :: held 1.517s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.439s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73b70d8-2eec-40df-9d5d-5511f6da8ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271db272cd6744408ce18256cacc091a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:40Z,use_quota=True,user_id='6c9270c88160471fa45896d0d9eb1426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a3f210-36a9-4ab4-b91b-2165d7b3128a),volume_type_id=72a3f210-36a9-4ab4-b91b-2165d7b3128a)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Creating volume b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:52 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:52 devstack sudo[112197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 1073741824
Jun 24 04:33:52 devstack sudo[112197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:52 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-dcfb9504-1687-4f5c-9323-897e2f6ec672 tempest-CreateVolumesFromSnapshotTest-534288489 None] Create snapshot completed successfully
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Created reservations ['745888bb-d3c1-4155-8c39-8864e7dac24e', '2ef1dc19-c51b-48f3-8896-ac821d8f03ee', '1c6f3a70-3bdf-4096-b66d-c32d74847f82', '4ba82447-ee4a-4f8d-9908-ec8bf64de03a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:52 devstack sudo[112199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:33:52 devstack sudo[112199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:52 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-d9882313-f404-4b22-9d27-066775360b0b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-d9882313-f404-4b22-9d27-066775360b0b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-quobyte-d9882313-f404-4b22-9d27-066775360b0b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-d9882313-f404-4b22-9d27-066775360b0b" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2629e4-6514-4792-899e-4e4a53af2e2c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:53 devstack sudo[112199]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.759s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Deleted volume successfully.
Jun 24 04:33:53 devstack sudo[112209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b
Jun 24 04:33:53 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-60d705af-f508-48c7-9223-bf39001494f5 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-714b1354-8eeb-4303-8a6f-88ff4ee64605-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:53 devstack sudo[112197]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 1073741824" returned: 0 in 0.966s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:53 devstack sudo[112212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4
Jun 24 04:33:53 devstack sudo[112212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (d469a227-57df-4d60-8b04-2330642cc150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765ac556-137e-4cad-8418-723db9be76b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765ac556-137e-4cad-8418-723db9be76b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1542770084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f091d97-a3d5-4ef0-a0d0-60478dff7d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:53Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9360ab9-ba22-40fb-9919-c08a1f6ca786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9360ab9-ba22-40fb-9919-c08a1f6ca786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1848b69c-91f6-4e55-a6c9-3f60e4c0daf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1848b69c-91f6-4e55-a6c9-3f60e4c0daf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f091d97-a3d5-4ef0-a0d0-60478dff7d7f', 'volume_name': 'volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716fde89-dab9-4bb6-bc72-418a95327c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716fde89-dab9-4bb6-bc72-418a95327c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fb57df-3cd3-4ae7-a9a5-9acd6f5eaff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume 3f091d97-a3d5-4ef0-a0d0-60478dff7d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f', 'volume_size': 1}
Jun 24 04:33:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (c3aeebff-30a5-4f02-b366-2a1bb142b4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:54 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c502e903-aa63-44d6-b72b-4273010ea3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack sudo[112212]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b" returned: 0 in 1.122s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" returned: 0 in 0.900s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.441s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693753195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8233a829-6ecb-42fc-8c39-e4df851db14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:46Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Creating volume 8233a829-6ecb-42fc-8c39-e4df851db14f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:54 devstack sudo[112254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:54 devstack sudo[112254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:54 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c502e903-aa63-44d6-b72b-4273010ea3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-126425010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26a22c0-bf4a-47bd-a0bd-707ea467db5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:54Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:54 devstack sudo[112256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f 1073741824
Jun 24 04:33:54 devstack sudo[112256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa00d219-e956-4c75-a911-08184cd3491e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa00d219-e956-4c75-a911-08184cd3491e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5892bfc8-9562-4b51-8333-fb37ad5ff77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5892bfc8-9562-4b51-8333-fb37ad5ff77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26a22c0-bf4a-47bd-a0bd-707ea467db5e', 'volume_name': 'volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6f8b48-ce87-46a0-8ac1-0e35c654a11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6f8b48-ce87-46a0-8ac1-0e35c654a11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995ca6a4-2466-44f6-9f05-58f673aac6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume a26a22c0-bf4a-47bd-a0bd-707ea467db5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e', 'volume_size': 1}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Attempting download of 95b857d0-2b27-413f-b2f7-7fe41098c850 ((None, [{'url': 'file:///opt/stack/data/glance/images/95b857d0-2b27-413f-b2f7-7fe41098c850', 'metadata': {}}])) to volume b73b70d8-2eec-40df-9d5d-5511f6da8ff4. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[330e9213-2fa1-401a-8f45-327e38dfd295]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95b857d0-2b27-413f-b2f7-7fe41098c850_t48iv8ej {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:54 devstack sudo[112258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95b857d0-2b27-413f-b2f7-7fe41098c850_t48iv8ej
Jun 24 04:33:54 devstack sudo[112258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (3aa5f543-6ea8-4bcd-809c-c231612223cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d46685-6c3b-4e79-b688-03720452c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d46685-6c3b-4e79-b688-03720452c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-405181000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3706c57c-c7ec-4b61-9005-31c36241622b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:55Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7862989b-17fa-48a1-8eb9-c138efa51b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7862989b-17fa-48a1-8eb9-c138efa51b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca54784-7728-4b87-b724-56033e021867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca54784-7728-4b87-b724-56033e021867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3706c57c-c7ec-4b61-9005-31c36241622b', 'volume_name': 'volume-3706c57c-c7ec-4b61-9005-31c36241622b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d699f6-cf69-472d-9728-0d546a25c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d699f6-cf69-472d-9728-0d546a25c8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17391cd0-4085-4912-87e7-6e260d3287e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:54 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume 3706c57c-c7ec-4b61-9005-31c36241622b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3706c57c-c7ec-4b61-9005-31c36241622b', 'volume_size': 1}
Jun 24 04:33:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:55 devstack sudo[112254]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9882313-f404-4b22-9d27-066775360b0b" returned: 0 in 0.980s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-d9882313-f404-4b22-9d27-066775360b0b" released by "delete_volume" :: held 2.164s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (49193c1a-09bd-4d00-817d-025c59bf220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c93e0d8-335c-4a49-9d86-b13649958389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c93e0d8-335c-4a49-9d86-b13649958389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401292994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d24088a-6b0b-4ef0-aec0-66ce51903297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:55Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d25a5f-1bc6-4009-8454-cbbf66e0e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d25a5f-1bc6-4009-8454-cbbf66e0e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489c6cdb-48b1-4979-85de-232e7283a0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489c6cdb-48b1-4979-85de-232e7283a0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d24088a-6b0b-4ef0-aec0-66ce51903297', 'volume_name': 'volume-5d24088a-6b0b-4ef0-aec0-66ce51903297', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d66f20-7348-4c30-8034-2fef736f1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d66f20-7348-4c30-8034-2fef736f1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcba8b02-09d7-403e-80ca-c00e04bc2954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume 5d24088a-6b0b-4ef0-aec0-66ce51903297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d24088a-6b0b-4ef0-aec0-66ce51903297', 'volume_size': 1}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Created reservations ['a50fc44e-3c52-4594-b0d5-daab423a5531', '466c41e0-fb8d-4cfd-bcd8-3a74418f7a21', '42232d99-006b-43c8-8f56-5b501c2a1b60', 'a9065cdf-0f54-4d45-8612-bef6ec9ba8f8'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:33:55 devstack sudo[112256]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f 1073741824" returned: 0 in 1.202s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:55 devstack sudo[112258]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:55 devstack sudo[112268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f
Jun 24 04:33:55 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_95b857d0-2b27-413f-b2f7-7fe41098c850_t48iv8ej" returned: 0 in 1.126s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95b857d0-2b27-413f-b2f7-7fe41098c850_t48iv8ej {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:55 devstack sudo[112271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:33:55 devstack sudo[112271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:33:55 devstack sudo[112270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95b857d0-2b27-413f-b2f7-7fe41098c850_t48iv8ej
Jun 24 04:33:55 devstack sudo[112270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (206f1155-906c-4a61-8939-f6d21cad09c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c7aa83-060b-4678-acea-ced5ebe43329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c7aa83-060b-4678-acea-ced5ebe43329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1073471253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0b9062-9e8f-4565-b458-d3bf9f296b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:56Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e70c5f-66d7-4101-83bc-713f8ae7ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e70c5f-66d7-4101-83bc-713f8ae7ed62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fef8d7-8466-4a9e-baa0-281526be4a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26fef8d7-8466-4a9e-baa0-281526be4a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e0b9062-9e8f-4565-b458-d3bf9f296b05', 'volume_name': 'volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a934db5e-a25a-49fb-9805-389152e34725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a934db5e-a25a-49fb-9805-389152e34725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21febbdd-3d5c-456f-96e7-91b9c1a1a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:55 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume 4e0b9062-9e8f-4565-b458-d3bf9f296b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05', 'volume_size': 1}
Jun 24 04:33:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:56 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f" returned: 0 in 0.760s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.061s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559250037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99d71d0-2c4f-454b-b466-7746d04749c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:46Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Creating volume a99d71d0-2c4f-454b-b466-7746d04749c5 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:56 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:56 devstack sudo[112278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5 1073741824
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65f67df-2c20-4d1b-b0d9-5f21d749a6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8233a829-6ecb-42fc-8c39-e4df851db14f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:56 devstack sudo[112278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6609885b-909d-45ac-9ff9-2b60256be7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:56 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume volume-8233a829-6ecb-42fc-8c39-e4df851db14f (8233a829-6ecb-42fc-8c39-e4df851db14f): created successfully
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6609885b-909d-45ac-9ff9-2b60256be7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:56 devstack sudo[112270]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (efdf86e7-9878-4ec2-8f59-9b16ca965b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95b857d0-2b27-413f-b2f7-7fe41098c850_t48iv8ej" returned: 1 in 0.823s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_95b857d0-2b27-413f-b2f7-7fe41098c850_t48iv8ej' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e524dd-45c6-46bf-93eb-77778894a32d]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c09c315d-0cf4-4f1b-83a0-4fd440238193 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created volume successfully.
Jun 24 04:33:56 devstack sudo[112271]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.791s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Deleted volume successfully.
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-a73cef36-8002-4248-b64b-37064fb28415-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-14f85016-5be2-434a-8cd4-e8d8ef851292 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-d9882313-f404-4b22-9d27-066775360b0b-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-a73cef36-8002-4248-b64b-37064fb28415-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-quobyte-a73cef36-8002-4248-b64b-37064fb28415" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:56 devstack sudo[112280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD
Jun 24 04:33:56 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-a73cef36-8002-4248-b64b-37064fb28415" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f105c-ba51-4aea-a768-e071fc93dc7a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:56 devstack sudo[112282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415
Jun 24 04:33:56 devstack sudo[112282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:57 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD" returned: 0 in 0.826s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:57 devstack sudo[112278]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5 1073741824" returned: 0 in 0.937s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:57 devstack sudo[112291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5
Jun 24 04:33:57 devstack sudo[112291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:57 devstack sudo[112289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD
Jun 24 04:33:57 devstack sudo[112289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:57 devstack sudo[112282]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415" returned: 0 in 0.843s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:57 devstack sudo[112296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415
Jun 24 04:33:57 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:57 devstack sudo[112291]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5" returned: 0 in 0.680s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.360s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-819848591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430f64fa-b56b-457c-ab24-2eb5054c1c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:46Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Creating volume 430f64fa-b56b-457c-ab24-2eb5054c1c26 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:57 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:58 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf5fd30-55b3-4a4a-9876-163b36750eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a99d71d0-2c4f-454b-b466-7746d04749c5', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3148be30-b8ab-4e80-b40d-b2fc6acac21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:58 devstack sudo[112302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26 1073741824
Jun 24 04:33:58 devstack sudo[112302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:58 devstack sudo[112289]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD" returned: 1 in 0.825s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] 95b857d0-2b27-413f-b2f7-7fe41098c850 was raw, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:58 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume volume-a99d71d0-2c4f-454b-b466-7746d04749c5 (a99d71d0-2c4f-454b-b466-7746d04749c5): created successfully
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3148be30-b8ab-4e80-b40d-b2fc6acac21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (d3448100-4e23-45bf-9cbf-ed539b1453fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:58 devstack sudo[112305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4
Jun 24 04:33:58 devstack sudo[112305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:58 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f235f0c7-af90-4b7d-91bc-b00cd41aa9f2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created volume successfully.
Jun 24 04:33:58 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a73cef36-8002-4248-b64b-37064fb28415" returned: 0 in 0.711s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-a73cef36-8002-4248-b64b-37064fb28415" released by "delete_volume" :: held 1.612s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Created reservations ['7699e8d5-e559-430c-abc5-bc329934a507', '46c7c0d2-3797-4695-a24b-7e19d2b6d4d6', '122344bd-c498-459d-96d1-1958ddbabb4f', '7ed35f7d-f07d-48a5-9643-44cc0816f922'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:58 devstack sudo[112307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:33:58 devstack sudo[112307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-d9f875e2-eec4-4217-a791-047989c02c6e-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-d9f875e2-eec4-4217-a791-047989c02c6e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "cinder-quobyte-d9f875e2-eec4-4217-a791-047989c02c6e" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-d9f875e2-eec4-4217-a791-047989c02c6e" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:33:58 devstack sudo[112305]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" returned: 0 in 0.864s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_95b857d0-2b27-413f-b2f7-7fe41098c850_f17t42htdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:33:58 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Converted 0.00 MB image at 0.00 MB/s
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[60725876-e6ae-4af8-b015-82874a9b8471]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:58 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:58 devstack sudo[112317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 1G
Jun 24 04:33:58 devstack sudo[112317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:58 devstack sudo[112307]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.689s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:33:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Deleted volume successfully.
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3867b4e0-313c-47cf-9bcc-781fffc46baa tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-a73cef36-8002-4248-b64b-37064fb28415-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:33:59 devstack sudo[112302]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26 1073741824" returned: 0 in 1.058s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:59 devstack sudo[112318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e
Jun 24 04:33:59 devstack sudo[112318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:59 devstack sudo[112321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26
Jun 24 04:33:59 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:59 devstack sudo[112317]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 1G" returned: 0 in 0.732s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d97d10-bc91-49d9-967b-97b3f2946885]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:59 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26" returned: 0 in 0.679s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.770s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-111334783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62295c8-5149-4a0e-bd57-30cc1678404c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:47Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Creating volume a62295c8-5149-4a0e-bd57-30cc1678404c {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:33:59 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:59 devstack sudo[112330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4
Jun 24 04:33:59 devstack sudo[112330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:59 devstack sudo[112318]: pam_unix(sudo:session): session closed for user root
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e" returned: 0 in 0.872s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:33:59 devstack sudo[112331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c 1073741824
Jun 24 04:33:59 devstack sudo[112331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e49f81bf-b6b3-4aec-b07d-1c2f0a757394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430f64fa-b56b-457c-ab24-2eb5054c1c26', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a40756-101b-4bed-b61b-f42c83992eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:33:59 devstack sudo[112333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e
Jun 24 04:33:59 devstack sudo[112333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:33:59 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume volume-430f64fa-b56b-457c-ab24-2eb5054c1c26 (430f64fa-b56b-457c-ab24-2eb5054c1c26): created successfully
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a40756-101b-4bed-b61b-f42c83992eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:33:59 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (32b8b8a2-fe05-4f4f-8e05-39434b13ddbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:33:59 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-1c08ea32-d94a-4d16-884b-174a82fa3c5c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created volume successfully.
Jun 24 04:34:00 devstack sudo[112330]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" returned: 0 in 0.802s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:00 devstack sudo[112333]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-d9f875e2-eec4-4217-a791-047989c02c6e" returned: 0 in 0.736s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-quobyte-d9f875e2-eec4-4217-a791-047989c02c6e" released by "delete_volume" :: held 1.669s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:00 devstack sudo[112342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4
Jun 24 04:34:00 devstack sudo[112342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Created reservations ['543148e0-b341-4c8c-bae6-a047c94b43c2', '00ccd96f-5568-47d4-87e9-c1f78f3c8e96', '21e4a6d5-c09f-45f3-b1ba-59d55d740fdc', '0d7df992-b1d6-4089-a4bf-96f2f74778a0'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:00 devstack sudo[112344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:00 devstack sudo[112344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:00 devstack sudo[112331]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c 1073741824" returned: 0 in 0.960s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:00 devstack sudo[112346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c
Jun 24 04:34:00 devstack sudo[112346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:01 devstack sudo[112342]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" returned: 1 in 0.813s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Downloaded image 95b857d0-2b27-413f-b2f7-7fe41098c850 ((None, [{'url': 'file:///opt/stack/data/glance/images/95b857d0-2b27-413f-b2f7-7fe41098c850', 'metadata': {}}])) to volume b73b70d8-2eec-40df-9d5d-5511f6da8ff4 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Temporary image 95b857d0-2b27-413f-b2f7-7fe41098c850 for user 6c9270c88160471fa45896d0d9eb1426 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Marking volume b73b70d8-2eec-40df-9d5d-5511f6da8ff4 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Copying metadata from image 95b857d0-2b27-413f-b2f7-7fe41098c850 to b73b70d8-2eec-40df-9d5d-5511f6da8ff4. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Creating volume glance metadata for volume b73b70d8-2eec-40df-9d5d-5511f6da8ff4 backed by image 95b857d0-2b27-413f-b2f7-7fe41098c850 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '95b857d0-2b27-413f-b2f7-7fe41098c850', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1830e4602786e0c447e380f5f327117b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:34:01 devstack sudo[112344]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.725s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Deleted volume successfully.
Jun 24 04:34:01 devstack sudo[112346]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c" returned: 0 in 0.707s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d3416200-fe86-4ece-b88d-4aed260fdb50 tempest-CreateVolumesFromImageTest-295976907 None] Lock "cinder-d9f875e2-eec4-4217-a791-047989c02c6e-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.095s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1718026575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429ce8b7-382b-4aea-9243-53e904ac2044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17418fc022a345d39f69d1f8407fd915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:47Z,use_quota=True,user_id='d134f52d5866418ea988551f8ec0e04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Creating volume 429ce8b7-382b-4aea-9243-53e904ac2044 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:01 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1a2087-9452-49a6-85e7-0d95c8534305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62295c8-5149-4a0e-bd57-30cc1678404c', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:01 devstack sudo[112353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044 1073741824
Jun 24 04:34:01 devstack sudo[112353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b9a36f-629b-4940-a365-7a2084074fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0271e853-bc53-4bbd-9967-35e2e095f83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4', 'volume_size': 1, 'image_id': '95b857d0-2b27-413f-b2f7-7fe41098c850', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/95b857d0-2b27-413f-b2f7-7fe41098c850', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1830e4602786e0c447e380f5f327117b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271db272cd6744408ce18256cacc091a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bdbd2f52ac0db996c403fdfeb37d7d882712641e6b9ba63ff16dd205afd56cecfc69c00cbe21fc1f3bcf88f11d9869f124dfc077a94eb0800dda256d29b8ae2', 'id': '95b857d0-2b27-413f-b2f7-7fe41098c850', 'created_at': datetime.datetime(2026, 6, 24, 2, 33, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 33, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/95b857d0-2b27-413f-b2f7-7fe41098c850/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9e62b9af0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcc86e7-5a74-43d0-8f35-97dc2f767dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume volume-a62295c8-5149-4a0e-bd57-30cc1678404c (a62295c8-5149-4a0e-bd57-30cc1678404c): created successfully
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b9a36f-629b-4940-a365-7a2084074fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (56959e53-be08-456a-bc5d-4209320ac3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Volume volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 (b73b70d8-2eec-40df-9d5d-5511f6da8ff4): created successfully
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfcc86e7-5a74-43d0-8f35-97dc2f767dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Flow 'volume_create_manager' (96dd46e3-0959-42a7-a2d8-3173ef21b913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6355fd88-047d-4ba0-8c02-2d6a4262c758 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created volume successfully.
Jun 24 04:34:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a2b52b4c-12ef-4a09-9e28-e6588f391a56 tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Created volume successfully.
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:01 devstack sudo[112355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:01 devstack sudo[112355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:02 devstack sudo[112353]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044 1073741824" returned: 0 in 0.989s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:02 devstack sudo[112355]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.784s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:34:02 devstack sudo[112362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:34:02 devstack sudo[112362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Acquiring lock "cinder-b73b70d8-2eec-40df-9d5d-5511f6da8ff4-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "cinder-b73b70d8-2eec-40df-9d5d-5511f6da8ff4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Acquiring lock "cinder-quobyte-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "cinder-quobyte-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" acquired by "delete_volume" :: waited 0.019s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[393810ac-e928-41f3-ac4b-ac151c4913a1]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:02 devstack sudo[112365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4
Jun 24 04:34:02 devstack sudo[112365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:03 devstack sudo[112362]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044" returned: 0 in 0.750s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.623s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1542770084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f091d97-a3d5-4ef0-a0d0-60478dff7d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:53Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Creating volume 3f091d97-a3d5-4ef0-a0d0-60478dff7d7f {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:03 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:03 devstack sudo[112368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f 1073741824
Jun 24 04:34:03 devstack sudo[112368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc7b0e8-4714-4e13-a219-f03b6a4f74dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429ce8b7-382b-4aea-9243-53e904ac2044', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12b8a6b-9ff6-404e-87cb-310297c68bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Volume volume-429ce8b7-382b-4aea-9243-53e904ac2044 (429ce8b7-382b-4aea-9243-53e904ac2044): created successfully
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12b8a6b-9ff6-404e-87cb-310297c68bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Flow 'volume_create_manager' (bda96ec8-8dcd-45da-bafa-c087ea63b397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-97b6a9cb-008f-4b61-a1fa-d8a544250ac2 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created volume successfully.
Jun 24 04:34:03 devstack sudo[112365]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" returned: 0 in 0.800s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:03 devstack sudo[112372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4
Jun 24 04:34:03 devstack sudo[112372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-429ce8b7-382b-4aea-9243-53e904ac2044-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-429ce8b7-382b-4aea-9243-53e904ac2044-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-quobyte-429ce8b7-382b-4aea-9243-53e904ac2044" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:03 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-429ce8b7-382b-4aea-9243-53e904ac2044" acquired by "delete_volume" :: waited 0.029s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:04 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc14db1-c07d-49bc-b825-6c5e09d6b8f7]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:04 devstack sudo[112374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044
Jun 24 04:34:04 devstack sudo[112374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:04 devstack sudo[112368]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f 1073741824" returned: 0 in 1.085s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:04 devstack sudo[112382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f
Jun 24 04:34:04 devstack sudo[112382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:04 devstack sudo[112372]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" returned: 1 in 0.919s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:04 devstack sudo[112384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4
Jun 24 04:34:04 devstack sudo[112384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:05 devstack sudo[112374]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044" returned: 0 in 1.025s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:05 devstack sudo[112390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044
Jun 24 04:34:05 devstack sudo[112390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:05 devstack sudo[112382]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f" returned: 0 in 0.731s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.856s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-126425010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26a22c0-bf4a-47bd-a0bd-707ea467db5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:54Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Creating volume a26a22c0-bf4a-47bd-a0bd-707ea467db5e {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:05 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:05 devstack sudo[112393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e 1073741824
Jun 24 04:34:05 devstack sudo[112393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fb57df-3cd3-4ae7-a9a5-9acd6f5eaff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d5674b-0523-4d39-8742-da0f37fdd7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:05 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f (3f091d97-a3d5-4ef0-a0d0-60478dff7d7f): created successfully
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d5674b-0523-4d39-8742-da0f37fdd7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (d469a227-57df-4d60-8b04-2330642cc150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-5e7445fa-6408-42e2-9984-2669ebd7b351 tempest-CreateVolumesFromSnapshotTest-534288489 None] Created volume successfully.
Jun 24 04:34:05 devstack sudo[112384]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" returned: 0 in 0.972s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "cinder-quobyte-b73b70d8-2eec-40df-9d5d-5511f6da8ff4" released by "delete_volume" :: held 2.766s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Created reservations ['6852e253-142b-4ab0-9153-b2577a7c0bb6', '0c2efc07-2072-4548-ace9-18f3702c9dc5', '3ab894cf-8eab-4570-9ccd-800bec3fee89', 'fab0cc46-7531-454d-9096-d5b8ee7d5059'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:05 devstack sudo[112397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:05 devstack sudo[112397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:05 devstack sudo[112390]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-429ce8b7-382b-4aea-9243-53e904ac2044" returned: 0 in 0.953s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-429ce8b7-382b-4aea-9243-53e904ac2044" released by "delete_volume" :: held 2.035s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created reservations ['5e7c93cd-84eb-415c-bd07-4f67f6a9b25e', 'db593f2c-bb89-476c-8a39-f7fbb0c05fdd', '1814649e-6ccf-4f3d-a8b1-122437a24acf', '431cbb74-f151-4ff4-b53e-d4de50d3771a'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:06 devstack sudo[112403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:06 devstack sudo[112403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:06 devstack sudo[112393]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e 1073741824" returned: 0 in 1.307s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:06 devstack sudo[112405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e
Jun 24 04:34:06 devstack sudo[112405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:06 devstack sudo[112397]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.974s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:06 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Deleted volume successfully.
Jun 24 04:34:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-fef130e3-1a36-4d2b-8b6a-f31d11cfc47a tempest-VolumeAndVolumeTypeFromImageTest-2091597185 None] Lock "cinder-b73b70d8-2eec-40df-9d5d-5511f6da8ff4-delete_volume" released by "delete_volume" :: held 4.075s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:07 devstack sudo[112403]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.914s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Deleted volume successfully.
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-2ad7cba9-1062-4667-b0dc-58ed56c8724b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-429ce8b7-382b-4aea-9243-53e904ac2044-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-a62295c8-5149-4a0e-bd57-30cc1678404c-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-a62295c8-5149-4a0e-bd57-30cc1678404c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-quobyte-a62295c8-5149-4a0e-bd57-30cc1678404c" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-a62295c8-5149-4a0e-bd57-30cc1678404c" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[740314c3-ff74-47d2-a8e8-a5a7c1e011bb]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:07 devstack sudo[112409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c
Jun 24 04:34:07 devstack sudo[112409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:07 devstack sudo[112405]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e" returned: 0 in 1.173s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] <== create_volume: return (2558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.566s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.938s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-405181000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3706c57c-c7ec-4b61-9005-31c36241622b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:55Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Creating volume 3706c57c-c7ec-4b61-9005-31c36241622b {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:07 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995ca6a4-2466-44f6-9f05-58f673aac6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:07 devstack sudo[112412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b 1073741824
Jun 24 04:34:07 devstack sudo[112412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7cbcda-bc31-47aa-9334-e022b39aab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:07 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e (a26a22c0-bf4a-47bd-a0bd-707ea467db5e): created successfully
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7cbcda-bc31-47aa-9334-e022b39aab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:07 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (c3aeebff-30a5-4f02-b366-2a1bb142b4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:07 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-17af29af-d68a-42b1-9a19-334f7e387ead tempest-CreateVolumesFromSnapshotTest-534288489 None] Created volume successfully.
Jun 24 04:34:08 devstack sudo[112409]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c" returned: 0 in 0.988s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:08 devstack sudo[112417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c
Jun 24 04:34:08 devstack sudo[112417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:09 devstack sudo[112412]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b 1073741824" returned: 0 in 1.197s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:09 devstack sudo[112423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b
Jun 24 04:34:09 devstack sudo[112423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:09 devstack sudo[112417]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a62295c8-5149-4a0e-bd57-30cc1678404c" returned: 0 in 0.999s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-a62295c8-5149-4a0e-bd57-30cc1678404c" released by "delete_volume" :: held 2.053s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created reservations ['b9b1f638-02c5-48c4-b8f9-7f47d7fc0af2', 'bbfee0cf-93d1-46ac-b0cc-75edb4ef9a46', '6a26c299-7100-4fda-9646-931678f2c563', '594520bd-6d00-4d6c-9c15-bd5732d1500e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:09 devstack sudo[112427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:09 devstack sudo[112427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:09 devstack sudo[112423]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b" returned: 0 in 0.809s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.450s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401292994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d24088a-6b0b-4ef0-aec0-66ce51903297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:55Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Creating volume 5d24088a-6b0b-4ef0-aec0-66ce51903297 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:09 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:09 devstack sudo[112429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297 1073741824
Jun 24 04:34:09 devstack sudo[112429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17391cd0-4085-4912-87e7-6e260d3287e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3706c57c-c7ec-4b61-9005-31c36241622b', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:09 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5ff1c4-3300-4e7f-9897-e1ee03a516d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:09 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume volume-3706c57c-c7ec-4b61-9005-31c36241622b (3706c57c-c7ec-4b61-9005-31c36241622b): created successfully
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5ff1c4-3300-4e7f-9897-e1ee03a516d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (3aa5f543-6ea8-4bcd-809c-c231612223cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7516eb58-10f1-4d56-a06a-fda963eb3c4a tempest-CreateVolumesFromSnapshotTest-534288489 None] Created volume successfully.
Jun 24 04:34:10 devstack sudo[112427]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.860s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:10 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Deleted volume successfully.
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-d01ce648-585e-40be-b017-8db274274abe tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-a62295c8-5149-4a0e-bd57-30cc1678404c-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-430f64fa-b56b-457c-ab24-2eb5054c1c26-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-430f64fa-b56b-457c-ab24-2eb5054c1c26-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-quobyte-430f64fa-b56b-457c-ab24-2eb5054c1c26" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-430f64fa-b56b-457c-ab24-2eb5054c1c26" acquired by "delete_volume" :: waited 0.032s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9548ae-1af0-4092-bc88-ebe0832279fa]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:11 devstack sudo[112429]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297 1073741824" returned: 0 in 1.184s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:11 devstack sudo[112436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26
Jun 24 04:34:11 devstack sudo[112436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:11 devstack sudo[112438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297
Jun 24 04:34:11 devstack sudo[112438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:12 devstack sudo[112436]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26" returned: 0 in 1.242s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:12 devstack sudo[112438]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297" returned: 0 in 1.057s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.368s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1073471253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0b9062-9e8f-4565-b458-d3bf9f296b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b27ca1a47a74d6bae22117f7c69bccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:33:56Z,use_quota=True,user_id='1813aa311957432396f790e16162f08a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Creating volume 4e0b9062-9e8f-4565-b458-d3bf9f296b05 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:12 devstack sudo[112444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26
Jun 24 04:34:12 devstack sudo[112444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:12 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:12 devstack sudo[112446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05 1073741824
Jun 24 04:34:12 devstack sudo[112446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcba8b02-09d7-403e-80ca-c00e04bc2954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d24088a-6b0b-4ef0-aec0-66ce51903297', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fff800c-97f0-4b42-b36c-33989d2e25ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:12 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume volume-5d24088a-6b0b-4ef0-aec0-66ce51903297 (5d24088a-6b0b-4ef0-aec0-66ce51903297): created successfully
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fff800c-97f0-4b42-b36c-33989d2e25ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:12 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (49193c1a-09bd-4d00-817d-025c59bf220b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e1f6f630-ca2d-4ca0-a357-9828b1701047 tempest-CreateVolumesFromSnapshotTest-534288489 None] Created volume successfully.
Jun 24 04:34:13 devstack sudo[112444]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-430f64fa-b56b-457c-ab24-2eb5054c1c26" returned: 0 in 0.981s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-430f64fa-b56b-457c-ab24-2eb5054c1c26" released by "delete_volume" :: held 2.281s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created reservations ['9a5fa7fe-e0d1-40c8-a661-880bb0cf3859', 'b806b0b1-2d3c-4d1a-89ad-6345fb6a55ce', '4e17695a-23a9-45c1-9d6e-5cd7e0bb7096', 'c8c2480a-8dfa-4b62-b72c-4205c968ba11'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:13 devstack sudo[112453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:13 devstack sudo[112453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:13 devstack sudo[112446]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05 1073741824" returned: 0 in 1.391s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:13 devstack sudo[112455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05
Jun 24 04:34:13 devstack sudo[112455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-a99d71d0-2c4f-454b-b466-7746d04749c5-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-a99d71d0-2c4f-454b-b466-7746d04749c5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-quobyte-a99d71d0-2c4f-454b-b466-7746d04749c5" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-a99d71d0-2c4f-454b-b466-7746d04749c5" acquired by "delete_volume" :: waited 0.023s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[709a8f37-46ae-47b6-a808-a80699f35cbf]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:14 devstack sudo[112453]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.288s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:14 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Deleted volume successfully.
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-13e6fa63-9e99-450a-92c7-d753e5aef55b tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-430f64fa-b56b-457c-ab24-2eb5054c1c26-delete_volume" released by "delete_volume" :: held 3.898s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:14 devstack sudo[112458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5
Jun 24 04:34:14 devstack sudo[112458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:14 devstack sudo[112455]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05" returned: 0 in 1.304s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] <== create_volume: return (2753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.757s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:14 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21febbdd-3d5c-456f-96e7-91b9c1a1a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019f397e-698b-4649-9c1d-8eca667424d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:15 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Volume volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05 (4e0b9062-9e8f-4565-b458-d3bf9f296b05): created successfully
Jun 24 04:34:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019f397e-698b-4649-9c1d-8eca667424d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:15 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Flow 'volume_create_manager' (206f1155-906c-4a61-8939-f6d21cad09c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:15 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-781fda12-2a03-47da-a8c0-2d6e1bb5d01a tempest-CreateVolumesFromSnapshotTest-534288489 None] Created volume successfully.
Jun 24 04:34:15 devstack sudo[112458]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5" returned: 0 in 1.001s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:15 devstack sudo[112465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5
Jun 24 04:34:15 devstack sudo[112465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-4e0b9062-9e8f-4565-b458-d3bf9f296b05-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-4e0b9062-9e8f-4565-b458-d3bf9f296b05-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-quobyte-4e0b9062-9e8f-4565-b458-d3bf9f296b05" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-4e0b9062-9e8f-4565-b458-d3bf9f296b05" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[81459739-3f9a-4713-a3f8-e4bd8d2271fd]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:16 devstack sudo[112467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05
Jun 24 04:34:16 devstack sudo[112467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:16 devstack sudo[112465]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a99d71d0-2c4f-454b-b466-7746d04749c5" returned: 0 in 0.815s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-a99d71d0-2c4f-454b-b466-7746d04749c5" released by "delete_volume" :: held 1.926s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created reservations ['dc193792-25f1-4990-8fbf-b31136acb26d', '803bcd43-3447-4180-945c-735f7e9e7434', '12b02af4-baa3-4b11-a598-a01d3bb70f3e', 'db865b01-65a8-4628-87ef-510d38a4451d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:16 devstack sudo[112470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:16 devstack sudo[112470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Flow 'volume_create_manager' (36fbc88c-de02-4a57-b3b1-089e10a7175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d76b93c-de25-4797-9bd8-dcbf51437d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d76b93c-de25-4797-9bd8-dcbf51437d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a99d713-bc3e-4d6d-8759-adb19b2c0215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02210c7c9bdc4c5396316b853595fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:17Z,use_quota=True,user_id='898dd8fca0414cb6818b14afbdd99315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac7dc7e-67e0-4adb-8e9e-bbf42dbd5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac7dc7e-67e0-4adb-8e9e-bbf42dbd5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae717bfe-8c60-4915-ade8-851570ff2ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.image.glance [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Creating Keystone auth plugin from conf {{(pid=93468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-8233a829-6ecb-42fc-8c39-e4df851db14f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-8233a829-6ecb-42fc-8c39-e4df851db14f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-quobyte-8233a829-6ecb-42fc-8c39-e4df851db14f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-8233a829-6ecb-42fc-8c39-e4df851db14f" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[83792324-c6d0-4fcf-b908-8fcca518a106]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:17 devstack sudo[112472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f
Jun 24 04:34:17 devstack sudo[112472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae717bfe-8c60-4915-ade8-851570ff2ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a99d713-bc3e-4d6d-8759-adb19b2c0215', 'volume_name': 'volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215', 'volume_size': 1, 'image_id': 'd3fa8080-6172-4fe7-b4c6-46b51e313016', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3fa8080-6172-4fe7-b4c6-46b51e313016', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0336f22d50d6e6fe5ffecd5a1e63355e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02210c7c9bdc4c5396316b853595fd62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8973dcb0daac2fc4b031d5556be9fb35a6d98414fc131922a7c2925cffe09cfd361ea89eea4f0c4c036d32808878e1203449a54ca3def691c16de9459b119405', 'id': 'd3fa8080-6172-4fe7-b4c6-46b51e313016', 'created_at': datetime.datetime(2026, 6, 24, 2, 34, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 34, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3fa8080-6172-4fe7-b4c6-46b51e313016/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f0b1b6b0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d8a76e-b617-4fd3-8cf5-febd29797380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d8a76e-b617-4fd3-8cf5-febd29797380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373be99b-e220-4de6-94cc-10e7d126996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:17 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Volume 7a99d713-bc3e-4d6d-8759-adb19b2c0215: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215', 'volume_size': 1, 'image_id': 'd3fa8080-6172-4fe7-b4c6-46b51e313016', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3fa8080-6172-4fe7-b4c6-46b51e313016', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0336f22d50d6e6fe5ffecd5a1e63355e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02210c7c9bdc4c5396316b853595fd62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8973dcb0daac2fc4b031d5556be9fb35a6d98414fc131922a7c2925cffe09cfd361ea89eea4f0c4c036d32808878e1203449a54ca3def691c16de9459b119405', 'id': 'd3fa8080-6172-4fe7-b4c6-46b51e313016', 'created_at': datetime.datetime(2026, 6, 24, 2, 34, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 34, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3fa8080-6172-4fe7-b4c6-46b51e313016/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f0b1b6b0>}
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Trying to clone 7a99d713-bc3e-4d6d-8759-adb19b2c0215 from image d3fa8080-6172-4fe7-b4c6-46b51e313016 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3fa8080-6172-4fe7-b4c6-46b51e313016', 'metadata': {}}]). {{(pid=93468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jun 24 04:34:17 devstack sudo[112467]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jun 24 04:34:17 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Image download 0.00 MB at 0.00 MB/s
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05" returned: 0 in 1.242s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:17 devstack sudo[112477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05
Jun 24 04:34:17 devstack sudo[112477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5814f140-7647-4168-93aa-45b53c3f0c94]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:17 devstack sudo[112479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD
Jun 24 04:34:17 devstack sudo[112479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:17 devstack sudo[112470]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.263s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:17 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Deleted volume successfully.
Jun 24 04:34:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-3257126a-6bd6-4c0b-8eef-8f4b294c078f tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-a99d71d0-2c4f-454b-b466-7746d04749c5-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:18 devstack sudo[112472]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f" returned: 0 in 1.237s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:18 devstack sudo[112486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f
Jun 24 04:34:18 devstack sudo[112486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:18 devstack sudo[112477]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-4e0b9062-9e8f-4565-b458-d3bf9f296b05" returned: 0 in 0.932s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-4e0b9062-9e8f-4565-b458-d3bf9f296b05" released by "delete_volume" :: held 2.240s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Created reservations ['df631657-6e11-42a5-9d36-1d3e027c4fa2', '765bd97d-6c25-4d6e-95d3-fa1e17481d95', '5ea04aac-0a3e-4145-bf43-6e45ddd1c73f', 'a6d21548-a061-4c6d-ad7b-b968ad48ce3e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:18 devstack sudo[112479]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD" returned: 0 in 1.034s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:18 devstack sudo[112490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:18 devstack sudo[112490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:18 devstack sudo[112491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD
Jun 24 04:34:18 devstack sudo[112491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:18 devstack sudo[112486]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-8233a829-6ecb-42fc-8c39-e4df851db14f" returned: 0 in 0.733s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-8233a829-6ecb-42fc-8c39-e4df851db14f" released by "delete_volume" :: held 2.045s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:18 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created reservations ['e526cb1e-f9a6-4cbc-84b2-2d48fd7cd710', '063d6851-8ffa-4616-9a17-518836624b59', 'c01ab508-f4af-4207-b3d4-1dbde346b72a', 'd0e068ea-422c-40fd-81d4-0b247ba73909'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:19 devstack sudo[112496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:19 devstack sudo[112496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-ca94576e-8860-4e07-b8db-78814314ee9e-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-ca94576e-8860-4e07-b8db-78814314ee9e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "cinder-quobyte-ca94576e-8860-4e07-b8db-78814314ee9e" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-ca94576e-8860-4e07-b8db-78814314ee9e" acquired by "delete_volume" :: waited 0.039s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-5d24088a-6b0b-4ef0-aec0-66ce51903297-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb79fe62-0112-49d5-9176-d6b62a2dc1cf]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-5d24088a-6b0b-4ef0-aec0-66ce51903297-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:19 devstack sudo[112490]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.075s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:19 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Deleted volume successfully.
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-quobyte-5d24088a-6b0b-4ef0-aec0-66ce51903297" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b82626a7-e725-4524-bc49-729de2e85912 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-4e0b9062-9e8f-4565-b458-d3bf9f296b05-delete_volume" released by "delete_volume" :: held 3.631s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:19 devstack sudo[112499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-5d24088a-6b0b-4ef0-aec0-66ce51903297" acquired by "delete_volume" :: waited 0.028s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:19 devstack sudo[112499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d12bf-5add-4402-8f09-9332ed4f5e8b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:19 devstack sudo[112491]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD" returned: 1 in 1.282s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Temporary image d3fa8080-6172-4fe7-b4c6-46b51e313016 is fetched for user 898dd8fca0414cb6818b14afbdd99315. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jun 24 04:34:19 devstack sudo[112504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297
Jun 24 04:34:19 devstack sudo[112504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[37761c1d-0ad7-4c7b-bbfd-92b3d09b4329]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:19 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:19 devstack sudo[112506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD
Jun 24 04:34:19 devstack sudo[112506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:20 devstack sudo[112496]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.087s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:20 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Deleted volume successfully.
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-6acda8e2-0df4-46d3-a2d6-22b6c5801fc3 tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-8233a829-6ecb-42fc-8c39-e4df851db14f-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:20 devstack sudo[112499]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e" returned: 0 in 1.067s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:20 devstack sudo[112512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e
Jun 24 04:34:20 devstack sudo[112512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:20 devstack sudo[112504]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297" returned: 0 in 1.175s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:20 devstack sudo[112520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297
Jun 24 04:34:20 devstack sudo[112520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:20 devstack sudo[112506]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD" returned: 0 in 1.024s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:20 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:21 devstack sudo[112522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD
Jun 24 04:34:21 devstack sudo[112522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:21 devstack sudo[112512]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ca94576e-8860-4e07-b8db-78814314ee9e" returned: 0 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-quobyte-ca94576e-8860-4e07-b8db-78814314ee9e" released by "delete_volume" :: held 1.998s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Created reservations ['e0b2da13-24fa-4fda-ac0a-b34196418aeb', '565f4cf1-c0d4-461c-9eaa-a9a67ce5e1a8', '2d27a6c4-fdaa-4277-93af-09145442e085', '234e90a4-b350-4c8c-a1ea-b9e70da13d5d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:21 devstack sudo[112526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:21 devstack sudo[112526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:21 devstack sudo[112520]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-5d24088a-6b0b-4ef0-aec0-66ce51903297" returned: 0 in 0.905s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-5d24088a-6b0b-4ef0-aec0-66ce51903297" released by "delete_volume" :: held 2.130s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Created reservations ['23012043-7cb9-4ff0-a6d6-46d4765cf9c0', 'd7940e13-6a51-46cd-8f0a-70b20fe44937', '4500cbef-90ec-4c76-ba3e-fc716f33eeb6', '74cdcb8f-2bf2-414c-97d3-623239261839'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:21 devstack sudo[112531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:21 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:21 devstack sudo[112522]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD" returned: 1 in 1.058s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a99d713-bc3e-4d6d-8759-adb19b2c0215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02210c7c9bdc4c5396316b853595fd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:17Z,use_quota=True,user_id='898dd8fca0414cb6818b14afbdd99315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Creating volume 7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:21 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:21 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:21 devstack sudo[112533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 1073741824
Jun 24 04:34:21 devstack sudo[112533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:22 devstack sudo[112526]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.858s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Deleted volume successfully.
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0c31d770-a009-4a10-b505-a15d155e6e3c tempest-CreateVolumesFromSourceVolumeTest-746855689 None] Lock "cinder-ca94576e-8860-4e07-b8db-78814314ee9e-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:22 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.820s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:22 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Deleted volume successfully.
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-c424ac51-007e-4a42-9b82-d9138081adda tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-5d24088a-6b0b-4ef0-aec0-66ce51903297-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-3706c57c-c7ec-4b61-9005-31c36241622b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-3706c57c-c7ec-4b61-9005-31c36241622b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:22 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-quobyte-3706c57c-c7ec-4b61-9005-31c36241622b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:23 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-3706c57c-c7ec-4b61-9005-31c36241622b" acquired by "delete_volume" :: waited 0.038s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:23 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b83f26-5368-4b30-a66c-c20f0733da2d]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:23 devstack sudo[112533]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 1073741824" returned: 0 in 1.271s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:23 devstack sudo[112541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b
Jun 24 04:34:23 devstack sudo[112541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:23 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:23 devstack sudo[112543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215
Jun 24 04:34:23 devstack sudo[112543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:24 devstack sudo[112541]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b" returned: 0 in 1.113s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:24 devstack sudo[112549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b
Jun 24 04:34:24 devstack sudo[112549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:24 devstack sudo[112543]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215" returned: 0 in 1.049s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.387s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Attempting download of d3fa8080-6172-4fe7-b4c6-46b51e313016 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3fa8080-6172-4fe7-b4c6-46b51e313016', 'metadata': {}}])) to volume 7a99d713-bc3e-4d6d-8759-adb19b2c0215. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ccf452-dc83-41e3-bc11-8e4069b0a3cd]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3fa8080-6172-4fe7-b4c6-46b51e313016_ym6yy_t_ {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:24 devstack sudo[112551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3fa8080-6172-4fe7-b4c6-46b51e313016_ym6yy_t_
Jun 24 04:34:24 devstack sudo[112551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:24 devstack sudo[112549]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:24 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3706c57c-c7ec-4b61-9005-31c36241622b" returned: 0 in 0.788s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-3706c57c-c7ec-4b61-9005-31c36241622b" released by "delete_volume" :: held 1.993s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Created reservations ['244a2ee4-54c2-470a-93fb-4e0686552453', '38f3c658-c272-47bf-b0ac-80a03d44aa63', '581d7243-c18a-4f59-a463-26921d579f16', 'a12fd995-4f20-432c-b329-f9d82f8625d4'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:25 devstack sudo[112557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:25 devstack sudo[112557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-a26a22c0-bf4a-47bd-a0bd-707ea467db5e-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-a26a22c0-bf4a-47bd-a0bd-707ea467db5e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:25 devstack sudo[112551]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3fa8080-6172-4fe7-b4c6-46b51e313016_ym6yy_t_" returned: 0 in 1.080s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3fa8080-6172-4fe7-b4c6-46b51e313016_ym6yy_t_ {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-quobyte-a26a22c0-bf4a-47bd-a0bd-707ea467db5e" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-a26a22c0-bf4a-47bd-a0bd-707ea467db5e" acquired by "delete_volume" :: waited 0.041s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:25 devstack sudo[112561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3fa8080-6172-4fe7-b4c6-46b51e313016_ym6yy_t_
Jun 24 04:34:25 devstack sudo[112561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea352f2-0ff4-4a6f-abf5-89fc7f46b079]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:25 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:25 devstack sudo[112563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e
Jun 24 04:34:25 devstack sudo[112563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:26 devstack sudo[112557]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.457s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:26 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Deleted volume successfully.
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-a3f65846-15d5-4386-952f-c652e138b127 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-3706c57c-c7ec-4b61-9005-31c36241622b-delete_volume" released by "delete_volume" :: held 3.823s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Flow 'volume_create_manager' (5ffce3ee-b451-42b0-8439-da7d8f11569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b30d36-a630-4cc1-83b0-45d3574ad682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b30d36-a630-4cc1-83b0-45d3574ad682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-521867895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7581a6-4c4b-4a9a-bfb1-29b499a17284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1ff40c3c64402cb345e7217130e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:27Z,use_quota=True,user_id='3014b3868fd1405eb07335fc593a25d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252a3620-fbb4-4a5a-8054-b108f44124c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252a3620-fbb4-4a5a-8054-b108f44124c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc43a555-fcf0-4b3a-acb4-099beba90136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc43a555-fcf0-4b3a-acb4-099beba90136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab7581a6-4c4b-4a9a-bfb1-29b499a17284', 'volume_name': 'volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0b0ead-5690-457a-a166-c11f95e7d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d0b0ead-5690-457a-a166-c11f95e7d4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a29a0-ab3d-4391-8d86-a04bbf0ee265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:26 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Volume ab7581a6-4c4b-4a9a-bfb1-29b499a17284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284', 'volume_size': 1}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-521867895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7581a6-4c4b-4a9a-bfb1-29b499a17284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1ff40c3c64402cb345e7217130e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:27Z,use_quota=True,user_id='3014b3868fd1405eb07335fc593a25d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Creating volume ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:26 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:26 devstack sudo[112561]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3fa8080-6172-4fe7-b4c6-46b51e313016_ym6yy_t_" returned: 1 in 1.382s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3fa8080-6172-4fe7-b4c6-46b51e313016_ym6yy_t_' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfcf668-e18c-4260-9be1-458b39dafe48]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:26 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:26 devstack sudo[112574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 1073741824
Jun 24 04:34:26 devstack sudo[112574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:27 devstack sudo[112575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD
Jun 24 04:34:27 devstack sudo[112575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:27 devstack sudo[112563]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e" returned: 0 in 1.483s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:27 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:27 devstack sudo[112581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e
Jun 24 04:34:27 devstack sudo[112581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:28 devstack sudo[112575]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD" returned: 0 in 1.261s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:28 devstack sudo[112581]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a26a22c0-bf4a-47bd-a0bd-707ea467db5e" returned: 0 in 0.978s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-a26a22c0-bf4a-47bd-a0bd-707ea467db5e" released by "delete_volume" :: held 2.552s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Created reservations ['0c9d9773-2e0f-4387-bdc4-4cde60679411', '5c108f5a-3721-40e6-8d70-774c117388c0', '3be489a2-6010-4bd3-b179-93d1cdd5e210', '4a114af3-f854-4758-993c-c4c473e56366'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:28 devstack sudo[112590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD
Jun 24 04:34:28 devstack sudo[112590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:28 devstack sudo[112592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:28 devstack sudo[112592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:28 devstack sudo[112574]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 1073741824" returned: 0 in 1.602s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:28 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:28 devstack sudo[112594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284
Jun 24 04:34:28 devstack sudo[112594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-quobyte-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f" acquired by "delete_volume" :: waited 0.045s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d1d0a4-c575-4950-96b8-6f7011f697b8]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:29 devstack sudo[112592]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.922s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Deleted volume successfully.
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4b327f2d-0d56-4c7c-a5b9-476a075cd5fe tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-a26a22c0-bf4a-47bd-a0bd-707ea467db5e-delete_volume" released by "delete_volume" :: held 3.955s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:29 devstack sudo[112594]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" returned: 0 in 1.011s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] <== create_volume: return (2679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.682s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:29 devstack sudo[112598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f
Jun 24 04:34:29 devstack sudo[112598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a29a0-ab3d-4391-8d86-a04bbf0ee265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88166914-4416-48d8-9f75-4616837da94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:29 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Volume volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 (ab7581a6-4c4b-4a9a-bfb1-29b499a17284): created successfully
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88166914-4416-48d8-9f75-4616837da94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Flow 'volume_create_manager' (5ffce3ee-b451-42b0-8439-da7d8f11569c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:29 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-c5ce6c90-30c0-41f2-95be-f27aa08ab1c4 tempest-VolumeDependencyTests-2144367458 None] Created volume successfully.
Jun 24 04:34:29 devstack sudo[112590]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD" returned: 1 in 1.515s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] d3fa8080-6172-4fe7-b4c6-46b51e313016 was raw, converting to raw {{(pid=93468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jun 24 04:34:29 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:29 devstack sudo[112604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215
Jun 24 04:34:29 devstack sudo[112604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Creating offline snapshot b520b4c4-239b-4d76-8ba2-c347958561cf of volume ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2fb915-e7fc-4829-b9f4-85ad9e6a693a]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:30 devstack sudo[112606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284
Jun 24 04:34:30 devstack sudo[112606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:30 devstack sudo[112598]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f" returned: 0 in 1.264s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:30 devstack sudo[112615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f
Jun 24 04:34:30 devstack sudo[112615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:30 devstack sudo[112604]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215" returned: 0 in 1.005s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3fa8080-6172-4fe7-b4c6-46b51e313016_ypq_sjyjdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:34:30 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Converted 0.00 MB image at 0.00 MB/s
Jun 24 04:34:30 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:30 devstack sudo[112617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 1G
Jun 24 04:34:30 devstack sudo[112617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:31 devstack sudo[112606]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" returned: 0 in 0.939s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:31 devstack sudo[112624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf 1G
Jun 24 04:34:31 devstack sudo[112624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:31 devstack sudo[112615]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f" returned: 0 in 0.853s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f" released by "delete_volume" :: held 2.201s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Created reservations ['2551d185-6448-4ec2-8aa4-b0ff23c0b4f8', 'b67dd52a-9f26-459c-8af2-08df96f93a2c', 'bef6ac3e-759a-4ce7-8e9e-14686604028b', '80597c4a-219e-42e3-af93-b62b2a619ed7'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:31 devstack sudo[112629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:31 devstack sudo[112629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:31 devstack sudo[112617]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 1G" returned: 0 in 1.099s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[63526d15-9328-4da1-b791-aa4be4cba522]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:31 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:32 devstack sudo[112631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215
Jun 24 04:34:32 devstack sudo[112631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:32 devstack sudo[112624]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf 1G" returned: 0 in 1.248s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:32 devstack sudo[112637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf
Jun 24 04:34:32 devstack sudo[112637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-1be6590f-4e26-4150-8f72-87ea5249bfdd-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-1be6590f-4e26-4150-8f72-87ea5249bfdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-quobyte-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-quobyte-1be6590f-4e26-4150-8f72-87ea5249bfdd" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-1be6590f-4e26-4150-8f72-87ea5249bfdd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Deleting offline snapshot 1be6590f-4e26-4150-8f72-87ea5249bfdd of volume 848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:34:32 devstack sudo[112629]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] snapshot_file for this snap is: volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.960s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:32 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Deleted volume successfully.
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[79755bd6-bbb2-4f9e-ab34-db2859677315]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-b8e03ee7-e99e-41af-8579-6e7975193439 tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-3f091d97-a3d5-4ef0-a0d0-60478dff7d7f-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:32 devstack sudo[112640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd
Jun 24 04:34:32 devstack sudo[112640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:32 devstack sudo[112631]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215" returned: 0 in 1.075s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:32 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:33 devstack sudo[112646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215
Jun 24 04:34:33 devstack sudo[112646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=196,cinder:SELECT=142,cinder:DELETE=13,cinder:INSERT=58 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Flow 'volume_create_manager' (45b7b652-9a56-439d-beae-de2e41043783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62a9953-990b-4477-9891-7d1d6405ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62a9953-990b-4477-9891-7d1d6405ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1101472521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98347ca-7b71-4a88-8e0e-df3a13d5d693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709ef22c242645aab29240bed7e14823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:33Z,use_quota=True,user_id='7ca8d74f859144ab9733c5ca1826ce49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6e814b-97c9-4d75-8432-b0a920507b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6e814b-97c9-4d75-8432-b0a920507b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3064d9f1-0f7b-4c94-8656-203b1048eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3064d9f1-0f7b-4c94-8656-203b1048eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98347ca-7b71-4a88-8e0e-df3a13d5d693', 'volume_name': 'volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469be771-82d9-45d9-bbf1-355b1fd1f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469be771-82d9-45d9-bbf1-355b1fd1f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e95ddb-5d03-4036-88d0-79ad9ca445ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Volume c98347ca-7b71-4a88-8e0e-df3a13d5d693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693', 'volume_size': 1}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:33 devstack sudo[112637]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf" returned: 0 in 0.922s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:33 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf is being set with open permissions: ugo+rw
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:33 devstack sudo[112652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf
Jun 24 04:34:33 devstack sudo[112652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:33 devstack sudo[112640]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd" returned: 0 in 1.016s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82d8c04-e2e7-4c8a-9768-a25c45383aa3]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:33 devstack sudo[112646]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:33 devstack sudo[112660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215" returned: 1 in 0.944s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:33 devstack sudo[112660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Downloaded image d3fa8080-6172-4fe7-b4c6-46b51e313016 ((None, [{'url': 'file:///opt/stack/data/glance/images/d3fa8080-6172-4fe7-b4c6-46b51e313016', 'metadata': {}}])) to volume 7a99d713-bc3e-4d6d-8759-adb19b2c0215 successfully. {{(pid=93468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Temporary image d3fa8080-6172-4fe7-b4c6-46b51e313016 for user 898dd8fca0414cb6818b14afbdd99315 is deleted. {{(pid=93468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.volume_utils [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Marking volume 7a99d713-bc3e-4d6d-8759-adb19b2c0215 as bootable. {{(pid=93468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Copying metadata from image d3fa8080-6172-4fe7-b4c6-46b51e313016 to 7a99d713-bc3e-4d6d-8759-adb19b2c0215. {{(pid=93468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Creating volume glance metadata for volume 7a99d713-bc3e-4d6d-8759-adb19b2c0215 backed by image d3fa8080-6172-4fe7-b4c6-46b51e313016 with: {'image_id': 'd3fa8080-6172-4fe7-b4c6-46b51e313016', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0336f22d50d6e6fe5ffecd5a1e63355e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:SELECT=134,cinder:UPDATE=203,cinder:INSERT=42,cinder:DELETE=24 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373be99b-e220-4de6-94cc-10e7d126996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215', 'volume_size': 1, 'image_id': 'd3fa8080-6172-4fe7-b4c6-46b51e313016', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3fa8080-6172-4fe7-b4c6-46b51e313016', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0336f22d50d6e6fe5ffecd5a1e63355e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02210c7c9bdc4c5396316b853595fd62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8973dcb0daac2fc4b031d5556be9fb35a6d98414fc131922a7c2925cffe09cfd361ea89eea4f0c4c036d32808878e1203449a54ca3def691c16de9459b119405', 'id': 'd3fa8080-6172-4fe7-b4c6-46b51e313016', 'created_at': datetime.datetime(2026, 6, 24, 2, 34, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 34, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3fa8080-6172-4fe7-b4c6-46b51e313016/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76e9f0b1b6b0>}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d36d88-dec8-4a45-b472-a637e06cbfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:33 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Volume volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 (7a99d713-bc3e-4d6d-8759-adb19b2c0215): created successfully
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d36d88-dec8-4a45-b472-a637e06cbfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:33 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Flow 'volume_create_manager' (36fbc88c-de02-4a57-b3b1-089e10a7175c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:34 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f2792e71-f314-4868-aedc-0bc235aaf74c tempest-VolumeImageDependencyTests-720695083 None] Created volume successfully.
Jun 24 04:34:34 devstack sudo[112652]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf" returned: 0 in 0.721s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:34 devstack sudo[112663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.info
Jun 24 04:34:34 devstack sudo[112663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:34 devstack sudo[112660]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" returned: 0 in 0.820s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:34 devstack sudo[112668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd
Jun 24 04:34:34 devstack sudo[112668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Acquiring lock "cinder-7a99d713-bc3e-4d6d-8759-adb19b2c0215-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Lock "cinder-7a99d713-bc3e-4d6d-8759-adb19b2c0215-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Acquiring lock "cinder-quobyte-7a99d713-bc3e-4d6d-8759-adb19b2c0215" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Lock "cinder-quobyte-7a99d713-bc3e-4d6d-8759-adb19b2c0215" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08d5c13-9b0e-4f19-b0a8-7510ba388fea]: (4, 'raw') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:34 devstack sudo[112663]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.info" returned: 0 in 0.676s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:34 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.info is being set with open permissions: ugo+rw
Jun 24 04:34:34 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:34 devstack sudo[112672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.info
Jun 24 04:34:34 devstack sudo[112672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:34 devstack sudo[112671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215
Jun 24 04:34:34 devstack sudo[112671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:35 devstack sudo[112668]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd" returned: 0 in 0.773s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:35 devstack sudo[112680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd
Jun 24 04:34:35 devstack sudo[112680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:35 devstack sudo[112672]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.info" returned: 0 in 0.657s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.290s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.234s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1101472521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98347ca-7b71-4a88-8e0e-df3a13d5d693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709ef22c242645aab29240bed7e14823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:33Z,use_quota=True,user_id='7ca8d74f859144ab9733c5ca1826ce49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Creating volume c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:35 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:35 devstack sudo[112685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 1073741824
Jun 24 04:34:35 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:35 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-ab28a100-523d-402d-ad9f-f00198e4b440 tempest-VolumeDependencyTests-2144367458 None] Create snapshot completed successfully
Jun 24 04:34:35 devstack sudo[112671]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215" returned: 0 in 0.838s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:35 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:35 devstack sudo[112687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215
Jun 24 04:34:35 devstack sudo[112687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:36 devstack sudo[112680]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353.1be6590f-4e26-4150-8f72-87ea5249bfdd" returned: 0 in 0.789s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-1be6590f-4e26-4150-8f72-87ea5249bfdd" released by "_delete_snapshot" :: held 3.534s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" released by "delete_snapshot" :: held 3.563s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Created reservations ['7a4687ec-9aad-4bd2-9c11-c7fb440b08b4', '53d59ded-76ff-4af0-a18f-44c7c258f008', '4f61aa0b-706c-4a2b-bc09-f8a024b27ed5', '1aed9578-e7ef-419e-a5f1-d0e738f65f3e'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:36 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Delete snapshot completed successfully.
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f79cef62-733a-48a1-9aa4-72bc507e603c tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-1be6590f-4e26-4150-8f72-87ea5249bfdd-delete_snapshot" released by "delete_snapshot" :: held 3.723s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:36 devstack sudo[112687]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215" returned: 1 in 0.846s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215' failed. Not Retrying. {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:36 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:36 devstack sudo[112697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 1073741824" returned: 0 in 0.949s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:36 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:36 devstack sudo[112699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693
Jun 24 04:34:36 devstack sudo[112699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "cinder-quobyte-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:36 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" acquired by "delete_volume" :: waited 0.027s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a5de86-dedd-4fb6-a6b8-8516391adb27]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:37 devstack sudo[112701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353
Jun 24 04:34:37 devstack sudo[112701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Flow 'volume_create_manager' (136471fb-fa69-45cc-9088-702c5f314267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5b38c2-a817-4de7-8f15-cf426f85335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5b38c2-a817-4de7-8f15-cf426f85335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1803847415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb1ff40c3c64402cb345e7217130e247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b520b4c4-239b-4d76-8ba2-c347958561cf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:37Z,use_quota=True,user_id='3014b3868fd1405eb07335fc593a25d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47650ee6-6b85-4305-941a-55aead3bbecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47650ee6-6b85-4305-941a-55aead3bbecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4d907b-4a9f-4fe4-bbaf-28e9167bf037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4d907b-4a9f-4fe4-bbaf-28e9167bf037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b', 'volume_name': 'volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b', 'volume_size': 1, 'snapshot_id': 'b520b4c4-239b-4d76-8ba2-c347958561cf'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c69ac2e-58b9-4b25-9e26-1be52d6fedd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c69ac2e-58b9-4b25-9e26-1be52d6fedd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:37 devstack sudo[112699]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defdb676-f124-4e22-8d28-805d01f95bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Volume a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b', 'volume_size': 1, 'snapshot_id': 'b520b4c4-239b-4d76-8ba2-c347958561cf'}
Jun 24 04:34:37 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693" returned: 0 in 0.830s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-7a99d713-bc3e-4d6d-8759-adb19b2c0215" returned: 0 in 0.908s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e95ddb-5d03-4036-88d0-79ad9ca445ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3348f2c2-4c0f-4940-930d-7f9166cc6dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Lock "cinder-quobyte-7a99d713-bc3e-4d6d-8759-adb19b2c0215" released by "delete_volume" :: held 2.687s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-quobyte-b520b4c4-239b-4d76-8ba2-c347958561cf-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:37 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Volume volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 (c98347ca-7b71-4a88-8e0e-df3a13d5d693): created successfully
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3348f2c2-4c0f-4940-930d-7f9166cc6dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Flow 'volume_create_manager' (45b7b652-9a56-439d-beae-de2e41043783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:37 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0d0af60c-4667-47d3-a52a-ad52bce56dbe tempest-SnapshotDependencyTests-1189791194 None] Created volume successfully.
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-b520b4c4-239b-4d76-8ba2-c347958561cf-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Creating volume a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b from snapshot b520b4c4-239b-4d76-8ba2-c347958561cf {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-quobyte-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] snapshot: b520b4c4-239b-4d76-8ba2-c347958561cf, volume: a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Created reservations ['fe57d6a0-9701-42b0-95aa-9eebb99deea4', '72815dbf-1fcf-43b7-8f0a-7c26774165a3', '27441ddb-9bb3-4e76-84f7-de53b76c22ed', '1f8212b2-b64c-4ab5-815d-4e8d994f7f75'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2b62b-ce43-461a-ab10-37d72641a228]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:37 devstack sudo[112705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf
Jun 24 04:34:37 devstack sudo[112705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:37 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:37 devstack sudo[112707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:37 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:38 devstack sudo[112701]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" returned: 0 in 1.008s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:38 devstack sudo[112713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353
Jun 24 04:34:38 devstack sudo[112713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:38 devstack sudo[112705]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf" returned: 0 in 0.945s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8fd168-8b2a-4b3f-891c-3960874b4ef0]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:38 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.879s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:38 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Deleted volume successfully.
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e9b72f60-b04b-4dc8-b4c6-f7559cdc3a2e tempest-VolumeImageDependencyTests-720695083 None] Lock "cinder-7a99d713-bc3e-4d6d-8759-adb19b2c0215-delete_volume" released by "delete_volume" :: held 4.035s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:38 devstack sudo[112719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284
Jun 24 04:34:38 devstack sudo[112719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:38 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:39 devstack sudo[112713]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" returned: 0 in 0.973s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-quobyte-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353" released by "delete_volume" :: held 2.076s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Created reservations ['7825e945-6179-41a2-ac2c-dd7d9b013703', 'e82a74ce-8540-4e9b-bfaa-4299b37f997b', 'acfc5f74-d614-42ce-a644-352f37a05ddb', '624cb50a-2570-4f16-8774-11be7628219b'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:39 devstack sudo[112722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:39 devstack sudo[112722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:39 devstack sudo[112719]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" returned: 0 in 1.051s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:39 devstack sudo[112728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b
Jun 24 04:34:39 devstack sudo[112728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:39 devstack sudo[112722]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.682s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:39 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Deleted volume successfully.
Jun 24 04:34:39 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-61c176bf-6119-4ddd-aeef-70bf85bda3cc tempest-CreateVolumesFromSnapshotTest-534288489 None] Lock "cinder-848e1bdc-a0b4-4f5f-b3c3-6fd32d50a353-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:45 devstack sudo[112728]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" returned: 0 in 5.534s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1534e6ce-be03-4a21-87a9-38d8f7349534]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:45 devstack sudo[112743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284
Jun 24 04:34:45 devstack sudo[112743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Flow 'volume_create_manager' (1c66cc5b-9e74-4e94-a737-ff26af37929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1771e738-45a9-4b19-b05e-6494413005c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1771e738-45a9-4b19-b05e-6494413005c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba2657b-dcb5-4140-889d-0e2eca6212bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79442ea366c74dc6bf08b19a8bd5a56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:46Z,use_quota=True,user_id='22b0b8c7ee0240a6b91d980661a0efb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91be4607-55ee-4d78-82f4-4f8bd106d2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91be4607-55ee-4d78-82f4-4f8bd106d2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8f482e-1d73-4021-b1f4-3385a10f9006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8f482e-1d73-4021-b1f4-3385a10f9006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba2657b-dcb5-4140-889d-0e2eca6212bf', 'volume_name': 'volume-bba2657b-dcb5-4140-889d-0e2eca6212bf', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9777cd2-0aa3-43c7-bea4-18d040b9ddde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9777cd2-0aa3-43c7-bea4-18d040b9ddde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8638072-3e87-4bdd-a39b-9aa04b641a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:45 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Volume bba2657b-dcb5-4140-889d-0e2eca6212bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba2657b-dcb5-4140-889d-0e2eca6212bf', 'volume_size': 1}
Jun 24 04:34:45 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:46 devstack sudo[112743]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" returned: 0 in 0.972s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:34:46 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Converted 1024.00 MB image at 185.01 MB/s
Jun 24 04:34:46 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b is being set with open permissions: ugo+rw
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:46 devstack sudo[112748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b
Jun 24 04:34:46 devstack sudo[112748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:46 devstack sudo[112748]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" returned: 0 in 0.624s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" released by "_copy_volume_from_snapshot" :: held 9.254s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-b520b4c4-239b-4d76-8ba2-c347958561cf-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" released by "_create_volume_from_snapshot" :: held 9.321s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.369s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.889s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Creating offline snapshot 481ba04a-2cc0-46fa-8cf8-9c08884be83d of volume c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defdb676-f124-4e22-8d28-805d01f95bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b', 'volume_size': 1, 'snapshot_id': 'b520b4c4-239b-4d76-8ba2-c347958561cf'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf840d3-83f1-42a0-ac53-9e4de3228042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c8837b-8eca-4ac9-9bd9-1e48892952ff]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:46 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Volume volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b (a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b): created successfully
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf840d3-83f1-42a0-ac53-9e4de3228042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:46 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Flow 'volume_create_manager' (136471fb-fa69-45cc-9088-702c5f314267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:46 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-699ae9d3-77de-4813-8cee-f3173aa948e6 tempest-VolumeDependencyTests-2144367458 None] Created volume successfully.
Jun 24 04:34:46 devstack sudo[112751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693
Jun 24 04:34:46 devstack sudo[112751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-b520b4c4-239b-4d76-8ba2-c347958561cf-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-b520b4c4-239b-4d76-8ba2-c347958561cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-quobyte-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-quobyte-b520b4c4-239b-4d76-8ba2-c347958561cf" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-b520b4c4-239b-4d76-8ba2-c347958561cf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Deleting offline snapshot b520b4c4-239b-4d76-8ba2-c347958561cf of volume ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] snapshot_file for this snap is: volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea50b9d-b1c1-4085-aef3-c5638098a675]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:47 devstack sudo[112753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf
Jun 24 04:34:47 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:47 devstack sudo[112751]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693" returned: 0 in 0.813s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:47 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:47 devstack sudo[112758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d 1G
Jun 24 04:34:47 devstack sudo[112758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:48 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf" returned: 0 in 0.783s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:48 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:34:48 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ea1708-dbcd-4900-912c-e218707b53ed]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:48 devstack sudo[112763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284
Jun 24 04:34:48 devstack sudo[112763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:48 devstack sudo[112758]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d 1G" returned: 0 in 0.910s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:48 devstack sudo[112769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d
Jun 24 04:34:48 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:48 devstack sudo[112763]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" returned: 0 in 0.833s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:48 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:48 devstack sudo[112774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf
Jun 24 04:34:48 devstack sudo[112774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:49 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d" returned: 0 in 0.710s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:49 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d is being set with open permissions: ugo+rw
Jun 24 04:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:49 devstack sudo[112779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d
Jun 24 04:34:49 devstack sudo[112779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:49 devstack sudo[112774]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf" returned: 0 in 0.786s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:49 devstack sudo[112784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf
Jun 24 04:34:49 devstack sudo[112784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:49 devstack sudo[112779]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d" returned: 0 in 0.638s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:49 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:49 devstack sudo[112787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.info
Jun 24 04:34:49 devstack sudo[112787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:50 devstack sudo[112784]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284.b520b4c4-239b-4d76-8ba2-c347958561cf" returned: 0 in 0.659s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-b520b4c4-239b-4d76-8ba2-c347958561cf" released by "_delete_snapshot" :: held 3.165s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" released by "delete_snapshot" :: held 3.189s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:50 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Created reservations ['10c918bc-21dd-417c-bfc2-220f44e27a2c', 'cba19f8b-7a2a-4a54-bdc8-ec81d8ad64c2', '8d8e4c82-0bbc-4e59-bd72-4de0c63f484d', 'e70db029-4eec-4798-8b8c-12fb0df47299'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:50 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Delete snapshot completed successfully.
Jun 24 04:34:50 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-266e4ec6-637b-44e6-aea9-86b936196f43 tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-b520b4c4-239b-4d76-8ba2-c347958561cf-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:50 devstack sudo[112787]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.info" returned: 0 in 0.703s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:50 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.info is being set with open permissions: ugo+rw
Jun 24 04:34:50 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:50 devstack sudo[112791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.info
Jun 24 04:34:50 devstack sudo[112791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:51 devstack sudo[112791]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.info" returned: 0 in 0.649s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.537s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.354s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba2657b-dcb5-4140-889d-0e2eca6212bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79442ea366c74dc6bf08b19a8bd5a56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:46Z,use_quota=True,user_id='22b0b8c7ee0240a6b91d980661a0efb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Creating volume bba2657b-dcb5-4140-889d-0e2eca6212bf {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:51 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:51 devstack sudo[112794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf 1073741824
Jun 24 04:34:51 devstack sudo[112794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:51 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-7b15b3ed-df67-4694-a52a-b3292e1dad73 tempest-SnapshotDependencyTests-1189791194 None] Create snapshot completed successfully
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-ab7581a6-4c4b-4a9a-bfb1-29b499a17284-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-ab7581a6-4c4b-4a9a-bfb1-29b499a17284-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-quobyte-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" acquired by "delete_volume" :: waited 0.018s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ef3ad0-8851-4139-ba51-e11492f40204]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:51 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:51 devstack sudo[112796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284
Jun 24 04:34:51 devstack sudo[112796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:52 devstack sudo[112794]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf 1073741824" returned: 0 in 0.947s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:52 devstack sudo[112796]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" returned: 0 in 0.799s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:52 devstack sudo[112805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf
Jun 24 04:34:52 devstack sudo[112805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:52 devstack sudo[112806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284
Jun 24 04:34:52 devstack sudo[112806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Flow 'volume_create_manager' (5ece317a-f2d1-4e18-bb48-a7360321afc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b679a92c-a0e5-4e33-84e6-fb75d8627355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b679a92c-a0e5-4e33-84e6-fb75d8627355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741b0bbb-ac6d-40b6-91c2-d88cea2de2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709ef22c242645aab29240bed7e14823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=481ba04a-2cc0-46fa-8cf8-9c08884be83d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:52Z,use_quota=True,user_id='7ca8d74f859144ab9733c5ca1826ce49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229f19ff-900b-482c-8f45-75d5ae9f0533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229f19ff-900b-482c-8f45-75d5ae9f0533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4025032-5df9-4c60-955e-66b8e379f6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4025032-5df9-4c60-955e-66b8e379f6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '741b0bbb-ac6d-40b6-91c2-d88cea2de2b8', 'volume_name': 'volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8', 'volume_size': 1, 'snapshot_id': '481ba04a-2cc0-46fa-8cf8-9c08884be83d'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c56a244-06e1-4dbf-a589-f5c181f174ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c56a244-06e1-4dbf-a589-f5c181f174ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20eda581-d3fa-46c4-a6fe-11ad8ef28913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:52 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Volume 741b0bbb-ac6d-40b6-91c2-d88cea2de2b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8', 'volume_size': 1, 'snapshot_id': '481ba04a-2cc0-46fa-8cf8-9c08884be83d'}
Jun 24 04:34:52 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:53 devstack sudo[112805]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf" returned: 0 in 0.707s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.527s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-quobyte-481ba04a-2cc0-46fa-8cf8-9c08884be83d-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" by "_create_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:53 devstack sudo[112806]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" returned: 0 in 0.702s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8638072-3e87-4bdd-a39b-9aa04b641a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba2657b-dcb5-4140-889d-0e2eca6212bf', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b739de94-4a92-4808-a66f-be79b6bbf5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-481ba04a-2cc0-46fa-8cf8-9c08884be83d-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Creating volume 741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 from snapshot 481ba04a-2cc0-46fa-8cf8-9c08884be83d {{(pid=93468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-quobyte-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" by "_copy_volume_from_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-ab7581a6-4c4b-4a9a-bfb1-29b499a17284" released by "delete_volume" :: held 1.585s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:53 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Volume volume-bba2657b-dcb5-4140-889d-0e2eca6212bf (bba2657b-dcb5-4140-889d-0e2eca6212bf): created successfully
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b739de94-4a92-4808-a66f-be79b6bbf5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Flow 'volume_create_manager' (1c66cc5b-9e74-4e94-a737-ff26af37929e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] snapshot: 481ba04a-2cc0-46fa-8cf8-9c08884be83d, volume: 741b0bbb-ac6d-40b6-91c2-d88cea2de2b8,  {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:53 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-49240eca-ab4d-4871-aa39-d4655c46b516 tempest-CinderUnicodeTest-625740059 None] Created volume successfully.
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7a2941-bcc5-4ee2-82e7-35eb2dd4f978]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Created reservations ['29ae520a-29c8-4742-b14e-367190fd4d79', '29cedb72-f93e-4805-ad11-5c3ab7882549', 'f7586072-2c82-4c6a-a9a2-5b9eacfb3bd5', '7c9eefe6-407a-4a94-981e-fb641c9b4a80'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:53 devstack sudo[112811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d
Jun 24 04:34:53 devstack sudo[112811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:53 devstack sudo[112813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:53 devstack sudo[112813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "cinder-quobyte-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" acquired by "delete_volume" :: waited 0.026s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e13e964-8cfa-40c9-80fb-9d877a9bf674]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:53 devstack cinder-volume[93468]: DEBUG cinder.volume.flows.manager.create_volume [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Flow 'volume_create_manager' (a5f8953d-446c-4d41-9346-07c4b416c3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6396fd7-e32c-447c-8c14-54cba925aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6396fd7-e32c-447c-8c14-54cba925aa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1771807876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9f9282-2648-4bc9-9e9f-dc8f045c5494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79442ea366c74dc6bf08b19a8bd5a56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:54Z,use_quota=True,user_id='22b0b8c7ee0240a6b91d980661a0efb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843760de-a491-45b8-9f82-64eb60e0d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843760de-a491-45b8-9f82-64eb60e0d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ade8a0f-4e6e-4182-9d74-6495cef8f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ade8a0f-4e6e-4182-9d74-6495cef8f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9f9282-2648-4bc9-9e9f-dc8f045c5494', 'volume_name': 'volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:54 devstack sudo[112815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b
Jun 24 04:34:54 devstack sudo[112815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e85cb29-ccfc-4309-b2b8-e36dc1bf7d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e85cb29-ccfc-4309-b2b8-e36dc1bf7d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09182135-bab9-4b37-8b16-3f6a9f5ae3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:34:54 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Volume de9f9282-2648-4bc9-9e9f-dc8f045c5494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494', 'volume_size': 1}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:54 devstack sudo[112813]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.767s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:54 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Deleted volume successfully.
Jun 24 04:34:54 devstack sudo[112811]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-4e906820-933b-4252-84dc-89c147af58fa tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-ab7581a6-4c4b-4a9a-bfb1-29b499a17284-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d" returned: 0 in 0.937s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Creating direct copy from snapshot {{(pid=93468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af7deba-b5e4-4da4-b317-6c4b84f22548]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:54 devstack sudo[112821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693
Jun 24 04:34:54 devstack sudo[112821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:54 devstack sudo[112815]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" returned: 0 in 0.848s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:54 devstack sudo[112863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b
Jun 24 04:34:54 devstack sudo[112863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:54 devstack sudo[112821]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693" returned: 0 in 0.767s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG cinder.utils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Path /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 not found in is_blk_device check {{(pid=93468) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jun 24 04:34:54 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:54 devstack sudo[112867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8
Jun 24 04:34:54 devstack sudo[112867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:55 devstack sudo[112863]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" returned: 0 in 0.680s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-quobyte-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b" released by "delete_volume" :: held 1.597s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Created reservations ['009bdbcc-486b-4c75-94e5-12ed705be0c9', 'c48eaad8-9449-4baf-a1fd-f453315dd778', 'b88655f1-2279-4730-a897-c221bd3f9fd9', '1fd6da6d-0ab8-4b00-b040-05a56d732c3f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:34:55 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:34:55 devstack sudo[112874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:34:55 devstack sudo[112874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:34:56 devstack sudo[112874]: pam_unix(sudo:session): session closed for user root
Jun 24 04:34:56 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 1.315s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:34:56 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:34:56 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Deleted volume successfully.
Jun 24 04:34:56 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-56dd62d2-ecfb-47cf-a145-ccd96b498f7b tempest-VolumeDependencyTests-2144367458 None] Lock "cinder-a1b743c4-d8c8-42ed-9c8f-6820c9d00f5b-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:00 devstack sudo[112867]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" returned: 0 in 5.395s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:00 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d2999d-dcb7-4bc5-bae9-33460827292e]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:00 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:00 devstack sudo[112885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693
Jun 24 04:35:00 devstack sudo[112885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:01 devstack sudo[112885]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693" returned: 0 in 0.911s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.image.image_utils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Image conversion details: src /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 {{(pid=93468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jun 24 04:35:01 devstack cinder-volume[93468]: INFO cinder.image.image_utils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Converted 1024.00 MB image at 189.77 MB/s
Jun 24 04:35:01 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 is being set with open permissions: ugo+rw
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:01 devstack sudo[112890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8
Jun 24 04:35:01 devstack sudo[112890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:01 devstack sudo[112896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:35:01 devstack sudo[112896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:01 devstack sudo[112890]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" returned: 0 in 0.619s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" released by "_copy_volume_from_snapshot" :: held 8.746s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-481ba04a-2cc0-46fa-8cf8-9c08884be83d-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" released by "_create_volume_from_snapshot" :: held 8.799s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.842s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.798s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76e9f197a7b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-06-24T02:34:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1771807876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9f9282-2648-4bc9-9e9f-dc8f045c5494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79442ea366c74dc6bf08b19a8bd5a56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:34:54Z,use_quota=True,user_id='22b0b8c7ee0240a6b91d980661a0efb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(978db5d1-e36d-40b9-831f-ccc4a139a459),volume_type_id=978db5d1-e36d-40b9-831f-ccc4a139a459)}" {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Creating volume de9f9282-2648-4bc9-9e9f-dc8f045c5494 {{(pid=93468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Selected osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e as target Quobyte volume. {{(pid=93468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jun 24 04:35:01 devstack cinder-volume[93468]: INFO cinder.volume.drivers.remotefs [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] casted to osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 1073741824 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:01 devstack sudo[112898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 1073741824
Jun 24 04:35:01 devstack sudo[112898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20eda581-d3fa-46c4-a6fe-11ad8ef28913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8', 'volume_size': 1, 'snapshot_id': '481ba04a-2cc0-46fa-8cf8-9c08884be83d'}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603c0773-9161-414a-a9fb-5c892a021ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:01 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Volume volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 (741b0bbb-ac6d-40b6-91c2-d88cea2de2b8): created successfully
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603c0773-9161-414a-a9fb-5c892a021ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:01 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Flow 'volume_create_manager' (5ece317a-f2d1-4e18-bb48-a7360321afc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:01 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-27024740-0290-46bc-a9c7-ea56440bd66a tempest-SnapshotDependencyTests-1189791194 None] Created volume successfully.
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-481ba04a-2cc0-46fa-8cf8-9c08884be83d-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-481ba04a-2cc0-46fa-8cf8-9c08884be83d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-quobyte-c98347ca-7b71-4a88-8e0e-df3a13d5d693" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-c98347ca-7b71-4a88-8e0e-df3a13d5d693" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-quobyte-481ba04a-2cc0-46fa-8cf8-9c08884be83d" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-481ba04a-2cc0-46fa-8cf8-9c08884be83d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Deleting offline snapshot 481ba04a-2cc0-46fa-8cf8-9c08884be83d of volume c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] snapshot_file for this snap is: volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a219ed-5aa8-4a30-a4ef-d013c40bad2b]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:02 devstack sudo[112896]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.682s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG oslo_service.periodic_task [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] Running periodic task VolumeManager._thread_info {{(pid=93468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread count: 28 {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-c9344672-00f7-4028-acf9-dd08805e2467 None None] thread info: [<_MainThread(MainThread, started 130747255484544)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130747149008192)>, <Thread(Thread-3 (stat_writer), started daemon 130747149183552)>, <Thread(Rabbit-heartbeat, started daemon 130747143850816)>, <Thread(Thread-5 (_runner), started daemon 130747144006272)>, <Thread(Thread-7 (_runner), started daemon 130747144022400)>, <Thread(fd_logger, started daemon 130747140656448)>, <Thread(privsep_reader, started daemon 130747138988544)>, <Thread(tpool_thread_0, started daemon 130747132413632)>, <Thread(tpool_thread_1, started daemon 130747124020928)>, <Thread(tpool_thread_2, started daemon 130747115611840)>, <Thread(tpool_thread_3, started daemon 130747107202752)>, <Thread(tpool_thread_4, started daemon 130747098793664)>, <Thread(tpool_thread_5, started daemon 130747090384576)>, <Thread(tpool_thread_6, started daemon 130747081975488)>, <Thread(tpool_thread_7, started daemon 130747073566400)>, <Thread(tpool_thread_8, started daemon 130747065157312)>, <Thread(tpool_thread_9, started daemon 130747056748224)>, <Thread(tpool_thread_10, started daemon 130747048339136)>, <Thread(tpool_thread_11, started daemon 130747039930048)>, <Thread(tpool_thread_12, started daemon 130747031520960)>, <Thread(tpool_thread_13, started daemon 130747023111872)>, <Thread(tpool_thread_14, started daemon 130747014702784)>, <Thread(tpool_thread_15, started daemon 130747006293696)>, <Thread(tpool_thread_16, started daemon 130746997884608)>, <Thread(tpool_thread_17, started daemon 130746989475520)>, <Thread(tpool_thread_18, started daemon 130746981066432)>, <Thread(tpool_thread_19, started daemon 130746972657344)>] {{(pid=93468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jun 24 04:35:02 devstack sudo[112901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d
Jun 24 04:35:02 devstack sudo[112901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:02 devstack sudo[112898]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 1073741824" returned: 0 in 0.939s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:02 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:02 devstack sudo[112906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494
Jun 24 04:35:02 devstack sudo[112906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:03 devstack sudo[112901]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d" returned: 0 in 0.775s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db576bf-edff-487a-afb6-2e4bf86049fa]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:03 devstack sudo[112911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693
Jun 24 04:35:03 devstack sudo[112911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:03 devstack sudo[112906]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494" returned: 0 in 0.637s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'} {{(pid=93468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09182135-bab9-4b37-8b16-3f6a9f5ae3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494', 'volume_size': 1}' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600ffecf-c739-45f2-a059-0436610d4554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jun 24 04:35:03 devstack cinder-volume[93468]: INFO cinder.volume.flows.manager.create_volume [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Volume volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 (de9f9282-2648-4bc9-9e9f-dc8f045c5494): created successfully
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600ffecf-c739-45f2-a059-0436610d4554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jun 24 04:35:03 devstack cinder-volume[93468]: DEBUG cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Flow 'volume_create_manager' (a5f8953d-446c-4d41-9346-07c4b416c3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jun 24 04:35:03 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-490f7ea1-0c77-4e0e-b24c-2604b9a46d41 tempest-CinderUnicodeTest-625740059 None] Created volume successfully.
Jun 24 04:35:04 devstack sudo[112911]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693" returned: 0 in 0.771s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:04 devstack sudo[112917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d
Jun 24 04:35:04 devstack sudo[112917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Creating offline snapshot 87b29164-bd99-4678-b9f0-f4ef2f970a68 of volume de9f9282-2648-4bc9-9e9f-dc8f045c5494 {{(pid=93468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[905d006d-8366-4ab6-ab97-d0c19e8e270c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:04 devstack sudo[112919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494
Jun 24 04:35:04 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:04 devstack sudo[112917]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d" returned: 0 in 0.757s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:04 devstack sudo[112924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d
Jun 24 04:35:04 devstack sudo[112924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:04 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494" returned: 0 in 0.749s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:04 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 1G {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:04 devstack sudo[112929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 1G
Jun 24 04:35:04 devstack sudo[112929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:05 devstack sudo[112924]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693.481ba04a-2cc0-46fa-8cf8-9c08884be83d" returned: 0 in 0.647s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-481ba04a-2cc0-46fa-8cf8-9c08884be83d" released by "_delete_snapshot" :: held 3.063s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-c98347ca-7b71-4a88-8e0e-df3a13d5d693" released by "delete_snapshot" :: held 3.087s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:05 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Created reservations ['362230ce-9845-4b53-bae4-6124ba8be93a', '4f5f1bb0-f369-4bff-ba0d-4e0361f4ddf8', 'a9e2ac7b-4fcb-4ccc-a1e4-a5a9aa9d9c60', 'b11449f4-d224-4dc3-9f72-690cdfb9c573'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:05 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Delete snapshot completed successfully.
Jun 24 04:35:05 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-f5101d50-cd1e-4bdf-b86e-8a9339969055 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-481ba04a-2cc0-46fa-8cf8-9c08884be83d-delete_snapshot" released by "delete_snapshot" :: held 3.246s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:05 devstack sudo[112929]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 1G" returned: 0 in 0.816s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:05 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:05 devstack sudo[112937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68
Jun 24 04:35:05 devstack sudo[112937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:06 devstack sudo[112937]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 -F qcow2 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68" returned: 0 in 0.685s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:06 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 is being set with open permissions: ugo+rw
Jun 24 04:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:06 devstack sudo[112942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68
Jun 24 04:35:06 devstack sudo[112942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-c98347ca-7b71-4a88-8e0e-df3a13d5d693-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-c98347ca-7b71-4a88-8e0e-df3a13d5d693-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-quobyte-c98347ca-7b71-4a88-8e0e-df3a13d5d693" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:06 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-c98347ca-7b71-4a88-8e0e-df3a13d5d693" acquired by "delete_volume" :: waited 0.014s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:06 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f8903f-67a7-4b4f-b9d7-f43605bf4404]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:06 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:06 devstack sudo[112944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693
Jun 24 04:35:06 devstack sudo[112944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:07 devstack sudo[112942]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68" returned: 0 in 0.662s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:07 devstack sudo[112947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.info
Jun 24 04:35:07 devstack sudo[112947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:07 devstack sudo[112944]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693" returned: 0 in 0.775s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:07 devstack sudo[112952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693
Jun 24 04:35:07 devstack sudo[112952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:07 devstack sudo[112947]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.info" returned: 0 in 0.692s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:07 devstack cinder-volume[93468]: WARNING cinder.volume.drivers.remotefs [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.info is being set with open permissions: ugo+rw
Jun 24 04:35:07 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.info {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:07 devstack sudo[112955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.info
Jun 24 04:35:07 devstack sudo[112955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:08 devstack sudo[112952]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-c98347ca-7b71-4a88-8e0e-df3a13d5d693" returned: 0 in 0.661s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-c98347ca-7b71-4a88-8e0e-df3a13d5d693" released by "delete_volume" :: held 1.496s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Created reservations ['c255b16a-8ad2-4715-b994-942df3808353', '73fa2b8e-c7dd-4c39-b9a1-353ed17c8af7', 'e0718239-7c08-41a1-92a4-cdb66474ecbf', '08d69f33-42dd-466d-9130-1a95396c0741'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:08 devstack sudo[112958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:35:08 devstack sudo[112958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:08 devstack sudo[112955]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.info" returned: 0 in 0.652s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.343s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-a88a8ad7-47ca-4dbe-8d49-1052d47b54c0 tempest-CinderUnicodeTest-625740059 None] Create snapshot completed successfully
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "cinder-quobyte-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" acquired by "delete_volume" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7e178d-8c30-49de-9b82-4ac31528cade]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:08 devstack sudo[112958]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.671s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:08 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Deleted volume successfully.
Jun 24 04:35:08 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-8267a0ed-bee8-4c09-a807-1504a9875ae6 tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-c98347ca-7b71-4a88-8e0e-df3a13d5d693-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:09 devstack sudo[112962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8
Jun 24 04:35:09 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "cinder-87b29164-bd99-4678-b9f0-f4ef2f970a68-delete_snapshot" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-87b29164-bd99-4678-b9f0-f4ef2f970a68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "cinder-quobyte-de9f9282-2648-4bc9-9e9f-dc8f045c5494" by "delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-quobyte-de9f9282-2648-4bc9-9e9f-dc8f045c5494" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "cinder-quobyte-87b29164-bd99-4678-b9f0-f4ef2f970a68" by "_delete_snapshot" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-quobyte-87b29164-bd99-4678-b9f0-f4ef2f970a68" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Deleting offline snapshot 87b29164-bd99-4678-b9f0-f4ef2f970a68 of volume de9f9282-2648-4bc9-9e9f-dc8f045c5494 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] snapshot_file for this snap is: volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 {{(pid=93468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69dddcd-b60e-4a4a-8fb8-6ff77247369c]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:09 devstack sudo[112964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68
Jun 24 04:35:09 devstack sudo[112964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:09 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" returned: 0 in 0.775s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:09 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:09 devstack sudo[112969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8
Jun 24 04:35:09 devstack sudo[112969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:10 devstack sudo[112964]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68" returned: 0 in 0.794s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.remotefs [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fa4f88-a5fa-4276-ad03-247b1e793542]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:10 devstack sudo[112969]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" returned: 0 in 0.658s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-quobyte-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8" released by "delete_volume" :: held 1.480s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Created reservations ['6fe48c01-6ccb-4995-a7a3-fe01ef545f66', '52f437d4-1fd8-4c42-882e-d12335a7bf0a', '4ccae47e-f26d-4df3-8fb4-03bb3a0ad580', '02846f60-d0c2-4133-8076-1b2adc2c235f'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:10 devstack sudo[112975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494
Jun 24 04:35:10 devstack sudo[112975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:10 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:10 devstack sudo[112977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:35:10 devstack sudo[112977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:11 devstack sudo[112975]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494" returned: 0 in 0.798s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:11 devstack sudo[112983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68
Jun 24 04:35:11 devstack sudo[112983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:11 devstack sudo[112977]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.672s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:11 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:11 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Deleted volume successfully.
Jun 24 04:35:11 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-cb0a82bd-3659-472e-8eb9-d0c21fd365df tempest-SnapshotDependencyTests-1189791194 None] Lock "cinder-741b0bbb-ac6d-40b6-91c2-d88cea2de2b8-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:11 devstack sudo[112983]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68" returned: 0 in 0.755s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:11 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:11 devstack sudo[112988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68
Jun 24 04:35:11 devstack sudo[112988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:12 devstack sudo[112988]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:12 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494.87b29164-bd99-4678-b9f0-f4ef2f970a68" returned: 0 in 0.708s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-quobyte-87b29164-bd99-4678-b9f0-f4ef2f970a68" released by "_delete_snapshot" :: held 3.171s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-quobyte-de9f9282-2648-4bc9-9e9f-dc8f045c5494" released by "delete_snapshot" :: held 3.192s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:12 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Created reservations ['8da7b008-1c99-4259-b9ee-3b59efd9122a', 'd6a31fe3-209b-446f-b1de-88a012e6d495', 'af2081bc-a558-4627-8842-a837fbda1d1e', '537681e9-1027-4310-a1cc-111113094254'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:12 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Delete snapshot completed successfully.
Jun 24 04:35:12 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-e7d8494c-88d8-4efd-99f5-d04117541342 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-87b29164-bd99-4678-b9f0-f4ef2f970a68-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "cinder-de9f9282-2648-4bc9-9e9f-dc8f045c5494-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-de9f9282-2648-4bc9-9e9f-dc8f045c5494-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "cinder-quobyte-de9f9282-2648-4bc9-9e9f-dc8f045c5494" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:13 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-quobyte-de9f9282-2648-4bc9-9e9f-dc8f045c5494" acquired by "delete_volume" :: waited 0.017s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:13 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b4bcc-2c2f-4b2f-a4ce-e3445a6a0de5]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:13 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:13 devstack sudo[112993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494
Jun 24 04:35:13 devstack sudo[112993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:14 devstack sudo[112993]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494" returned: 0 in 0.811s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:14 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:14 devstack sudo[112998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494
Jun 24 04:35:14 devstack sudo[112998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:15 devstack sudo[112998]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-de9f9282-2648-4bc9-9e9f-dc8f045c5494" returned: 0 in 0.716s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-quobyte-de9f9282-2648-4bc9-9e9f-dc8f045c5494" released by "delete_volume" :: held 1.595s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Created reservations ['f051e4f6-6922-4ef7-bf99-6be740f9dd97', '78fb62dd-421f-4c49-9f80-4c576a522b97', '2ced955f-214e-4368-b191-bd89a072c998', 'f6a7877f-e270-4204-9319-e48cff13ee75'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:15 devstack sudo[113003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:35:15 devstack sudo[113003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Acquiring lock "cinder-bba2657b-dcb5-4140-889d-0e2eca6212bf-delete_volume" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Lock "cinder-bba2657b-dcb5-4140-889d-0e2eca6212bf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:15 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Acquiring lock "cinder-quobyte-bba2657b-dcb5-4140-889d-0e2eca6212bf" by "delete_volume" {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jun 24 04:35:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Lock "cinder-quobyte-bba2657b-dcb5-4140-889d-0e2eca6212bf" acquired by "delete_volume" :: waited 0.034s {{(pid=93468) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jun 24 04:35:16 devstack cinder-volume[93468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f93fce5-6f21-47b7-bb16-dceb28b9a1c5]: (4, 'qcow2') {{(pid=94794) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jun 24 04:35:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:16 devstack sudo[113003]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.734s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:16 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:16 devstack sudo[113006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf
Jun 24 04:35:16 devstack sudo[113006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:16 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Deleted volume successfully.
Jun 24 04:35:16 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-9a5319de-dc3a-4d80-9430-b2e1f9c6ef69 tempest-CinderUnicodeTest-625740059 None] Lock "cinder-de9f9282-2648-4bc9-9e9f-dc8f045c5494-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:16 devstack sudo[113006]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf" returned: 0 in 0.846s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:16 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:16 devstack sudo[113012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf
Jun 24 04:35:16 devstack sudo[113012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:17 devstack sudo[113012]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019/volume-bba2657b-dcb5-4140-889d-0e2eca6212bf" returned: 0 in 0.662s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Lock "cinder-quobyte-bba2657b-dcb5-4140-889d-0e2eca6212bf" released by "delete_volume" :: held 1.569s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG cinder.quota [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Created reservations ['7eb5657e-dbb5-47fe-b8f2-011f72893c9f', 'd320dc17-73be-4df5-8729-054f34d445b3', 'd8f76b30-b0fe-4948-9131-d0a19425c1a5', 'f1ab4d28-afa7-43a2-8da8-d06f76acd96d'] {{(pid=93468) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e': None} {{(pid=93468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG cinder.volume.drivers.quobyte [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a5c54b3b-b8da-4f75-ad5e-979d197e2d6e'] {{(pid=93468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.lockutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jun 24 04:35:17 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019 {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jun 24 04:35:17 devstack sudo[113015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019
Jun 24 04:35:17 devstack sudo[113015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jun 24 04:35:18 devstack sudo[113015]: pam_unix(sudo:session): session closed for user root
Jun 24 04:35:18 devstack cinder-volume[93468]: DEBUG oslo_concurrency.processutils [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/61b6777e3c280661291955ee264c6019" returned: 0 in 0.779s {{(pid=93468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jun 24 04:35:18 devstack cinder-volume[93468]: DEBUG cinder.manager [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Notifying Schedulers of capabilities ... {{(pid=93468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jun 24 04:35:18 devstack cinder-volume[93468]: INFO cinder.volume.manager [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Deleted volume successfully.
Jun 24 04:35:18 devstack cinder-volume[93468]: DEBUG cinder.coordination [None req-0b11d1c6-b3de-4ec7-8dc1-d564a996a6be tempest-CinderUnicodeTest-625740059 None] Lock "cinder-bba2657b-dcb5-4140-889d-0e2eca6212bf-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=93468) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jun 24 04:35:27 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:UPDATE=106,cinder:SELECT=89,cinder:INSERT=32,cinder:DELETE=8 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jun 24 04:35:28 devstack cinder-volume[93468]: DEBUG dbcounter [-] [93468] Writing DB stats cinder:INSERT=30,cinder:UPDATE=104,cinder:SELECT=83,cinder:DELETE=9 {{(pid=93468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}